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- Tliis  report  documents  a study  of  the  user  acceptance  and  usability  of  the  technical  data  developed  uridcr  the 
C-141  Job  Guide  Technical  Order  (TO)  Program.  Step-hy  step,  illustrated  technical  orders,  called  job  guides,  were 
developed  to  rcjilace  the  original  TOs  on  the  C-141  aircraft.  Job  guides  are  chaiacicri/ed  by  detailed,  fully 
priKcdurali/cd  task  instruction  which  arc  keyed  to  illustrations  which  identify  each  component  and  its  lixation. 
Other  features  include  a small  handhixik  si/c,  standardized  verb  usage,  simplified  wnting  style,  job  preparation 
instructions,  identification  of  tools  and  parts  required,  and  little  or  no  referencing  to  other  TO; 

In  this  first  large-scale  application  of  the  )ob  guide  concept,  the  following  jxisitive  and  negative  factors 
affecting  usability  and  user  acceptance  were  identified  using  questionnaires,  interviews  and  observation  — 
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Positiva  Facton  Included,  small  si/.c,  case  of  reading  and  understanding; good  illusitations  keyed  to  procedures;  job 
preparation  information,  and  information  acceptable  to  botli  experienced  and  inexperienced  technicians. 

Nagativt/Factors  included;  too  many  volumes  required  for  some  task  sequences,  errors  in  the  data;  inability  to  locate 
information  quickly,  storage  problems;  and  tom  and  lost  pages. 

Although  problems  existed,  the  C-141  job  guides  arc  considered  to  be  very  usable  and  well-accepted.  It  is 
obvious  that  the  development  of  the  data  and  the  implementation  of  tlic  data  are  two  very  critical  factors  in  the 
success  of  the  job  guide  concept. 
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SUMMARY 


ProNem 

As  part  of  its  technical  order  improvement  program,  the  Air  Force  recently  procured  an  improved 
system  of  technical  data  for  maintenance  of  the  C141  aircraft.  The  data  include  job  guide  manuals  (JGM), 
logic  tree  troublcslrooting  aids  (l.TTA),  and  supporting  data  for  the  on-equipment  maintenance  of  the 
aircraft.  This  represents  the  first  application  of  this  type  of  data  on  a large  scale,  operational  basis.  It  had 
been  established  that  the  use  of  JCiMs  and  LTTAs  could  improve  maintenance  efficiency.  However,  it  was 
not  known  how  well  tlie  new  procedurali/ed  data  would  be  accepted  by  the  users  or  what  problems  would 
be  encountered  in  implementing  and  using  the  data  in  an  operational  environment.  Tlie  study  described  in 
this  reprrrt  was  designed  to  obtain  answers  to  these  questions. 

Approach 

Interviews,  observation  and  questionnaires  were  used  to  evaluate  the  acceptance  and  usability  of  the 
new  technical  data.  Data  were  collected  in  three  pliascs,  before  implementation  of  the  new  data,  shortly 
after  implementation,  and  approximately  six  to  ciglit  months  after  implementation.  In  Riase  I 
(approximately  three  niontlis  before  implementation),  interviews,  observation  and  a short  questionnaire 
were  used  to  obtain  a measure  of  the  attitudes  of  technicians  toward  the  use  of  priKcduralized  technical 
data  and  how  well  they  expected  to  like  to  use  the  JfJMs  and  LTTAs.  In  Pliase  II  (six  to  eiglit  weeks  after 
implementation),  observations  and  interviews  were  used  to  identify  problems  encountered  in  the 
implementation  ol  tlie  data  and  to  obtain  an  indication  of  initial  attitudes  toward  use  of  the  new  technical 
data.  In  Phase  III  (six  to  eight  months  alter  implementation),  interviews,  observation,  and  a T7-item 
questionnaire  were  used  to  measure  user  attitudes  toward  the  data  and  to  evaluate  progress  in  overcoming 
problems  encountered  in  the  implementation  of  the  data. 

Results 

The  results  ol  the  interviews,  observations,  and  questionnaires  indicate  that  the  program  has  been 
successful.  The  JGMs  and  LTTAs  generally  have  been  well  accepted,  altliougli  some  resistance  to  change 
was  encountered.  The  new  technical  data  have  generally  been  considered  to  be  superior  to  the  technical 
orders  that  they  replaced. 

Several  factors  were  identified  which  had  either  a positive  or  a negative  effect  on  the  acceptability 
and  usability  of  the  data.  Factors  which  had  a positive  effect  on  acceptance  and  usability  included;  size  of 
the  JGMs,  clarity  of  the  instruction,  organization  of  materials,  use  of  illustrations,  and  dual-level 
presentation  of  instructions.  Negative  factors  affecting  acceptance  and  usability  included:  resistance  to 
change,  errors  in  the  data,  requirements  to  use  more  than  one  volume  for  some  jobs,  inadequate  provisions 
for  storing  the  data,  easily  tom  pages,  difficulty  in  locating  prixedures,  and  implementation  problems. 

A number  of  problems  were  encountered  in  implenKnting  the  data,  resulting  in  a negative  impact  on 
the  acceptance  of  tlie  data.  These  problems  resulted  primarily  from  poor  communication  regarding  when 
and  how  the  data  are  to  be  used  and  inadequate  training  on  how  to  use  the  data.  A number  of 
recommendations  are  made  in  the  report  to  facilitate  the  implementation  of  data  for  future  programs. 

Recoin  mendations 

The  following  recommendations  sliould  be  considered  by  Ar  Force  and  other  IXII)  agencies  when 
job  guide  type  technical  data  are  being  procured. 

1.  A thorough  task  analysis  should  be  accomplished  to  provide  the  data  base  for  the  development  of 
the  technical  data. 

2.  The  contractor  developing  the  data  should  be  given  free  access  to  the  subject  equipment 
throughout  the  development  process. 

3.  A thorough  verification  of  the  data  sliould  be  accomplislied. 
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4.  Consideration  should  be  given  to  use  of  the  dual-level  approach  for  presenting  instructions. 

5.  More  durable  paper  and  binders  should  be  ntili/ed. 

6.  Training  sirould  be  provided  for  all  users  on  the  use  of  the  data. 

7.  A comprehensive  implementation  plan  should  be  developed  and  utilized  to  insure  a smooth 
introduction  of  the  data. 

8.  Special  provisions  should  be  made  to  insure  rapid  correction  of  errors  in  the  data. 
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ILSl  R A(  VI  IM  ANCl  AND  USABI1H  Y ()l  TUI-  ( -141 
JOBCiUlDl  I l.CHNK  A1  ORDLR  SYSTI'.M 


1.  IMKODUTION 

li  is  gcner;illv  acknowledged  among  maintenance  teclinicians  and  |iersonnel  engaged  in  technical  order 
research  that  the  present  Air  I orcc  technical  orders  are  hard  to  use.  Technicians  com[)lain  that  it  is  dilTicult 
to  locate  lecpiired  inlormation  and  that  the  mlormation  provided'otten  is  dinicnlt  to  understand.  Many 
Ix'lieve  that  signiTicant  improvements  in  Air  l orcc  maintenance  can  result  from  the  development  and 
application  ol  improved  types  of  technical  orders. 

I or  several  years  various  research  projects  have  been  conducted  by  the  Air  force  and  other  IX)1) 
agencies  to  develop  improved  technical  orders  (TO).  Several  types  of  improved  technical  data  have  been 
developed  as  a result  of  this  reasearch.  One  new  type  of  technical  data  has  recently  been  adopted  for  use  by 
the  Alt  force  in  the  Air  force  Technical  Order  Improvement  I’rogram.  Idiis  type  of  data,  called  job  guide 
manuals,  is  designed  with  the  iiumtcnance  technician  in  mind.  1 Tnphasis  is  placed  on  providing  all  of  the 
intonnation  that  the  technician  needs  to  do  the  job  In  one  place  and  insuring  that  it  is  written  in  a clear  and 
easily  understood  manner.  Die  job  guide  manuals  are  actually  part  of  a complete  system  of  technical  data. 
The  system  is  composed  of  jof  guide  manuals  (JOMs),  logic  tree  troiihleshooting  aids  (l.TTA),  wiring 
diagram  manuals  (WDM),  gener;  I aircraft  manuals  (0AM)  which  provide  general  aircraft  infomiation  on 
theory  of  operation,  and  maintenance  supixirt  information  manuals  (MSIM)  which  provide  miscellaneous 
information  re<iuircd  to  maintain  the  system,  for  convenience  the  entire  system  has  come  to  be  called  the 
joh  guide  system,  or  simply  job  guides. 

Dus  study  was  accomplished  to  answer  questions  about  the  usability  and  user  acceptance  of  the  new 
tully  priKcdurali/cd  type  of  technical  manuals  purcha.sed  for  on-equipment  maintenance  of  the  C-141 
aircraft  Many  years  of  study  and  research  have  been  devoted  to  the  development  of  this  improved  type  of 
technical  data.  Very  little  information  exists,  however,  concerning  the  users’  attitudes  toward  the  new  data, 
or  whether  it  is.  in  fact,  easier  for  them  to  read  and  use.  Ttie  purchase  of  job  guides  for  the  ('-141  aircraft 
oflered  the  first  opportunity  to  study  the  user  acceptance  and  usability  aspects  of  the  new  procedurali/ed 
data  in  a large-scale  o|rerational  environment. 

PurpiKe 

Die  information  contained  herein  is  intended  to  provide  guidance  to  other  Air  force  and  Department 
ol  iX’lense  ager-ies  as  they  prepare  to  purchase  and  implement  job  guide-type  technical  manuals 

The  specific  purpose  of  this  project  was  to  obtain  data  relative  to  the  following  questions 

1.  How  well  are  the  job  guides  accepted  by  using  fiersonnel  ’ Wliat  characteristics  do  the  technicians 
like’’  Wliat  characteristics  do  they  dislike’’ 

2.  Are  the  job  guides  usable’’  Wliat  characteristics  make  them  easier  to  u.se’’  Wliat  characteristics 
hinder  their  use’’ 

3.  Wliat  problems  are  encountered  in  implementing  the  job  guides’’  Mow  can  problemscncountered 
lx;  corrected  and  avoided  in  future  job  guide  program’’ 

Background 

Tile  development  of  procedurali/.ed  data  resulted  from  the  recognition  that  traditional  Air  force 
manuals  often  did  not  adequately  support  the  user  in  the  work  situation.  C’omplaints  from  the  users  about 
the  difficulty  of  finding  and  understanding  specific  information  in  technical  manuals  are  long  standing.  A 
study  by  larsee,  Allen,  Stroud,  and  Ver  Mulst  ( 1%2)  identified  siwcific  problems  with  Air  force  technical 
manuals,  such  as  incomplete  data,  infonnation  hard  to  find,  inlormation  too  difficult  to  read  and 
understand,  and  lack  of  specific  instructions. 
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^ The  t'lrsl  major  clfort  in  tire  dcvcloi'incnl  ol  jirocedurali/cd  data  was  the  Presentation  of  Inl'onnation 

for  Maintenance  and  Oj'erations  (PIMO)  project  (Serendij'lty,  Inc.,  I’lMO  was  an  Air  force  project 

conducted  by  Serendipity.  Inc.,  from  to  lOh*).  I 'rider  the  PIMO  project.  Inlly  juocednrali/ed 

instructions  for  non  troubleshooting  ta.sks  (similar  to  job  guide  manual  '.  and  sinij'litied  imuntenance 
dependency  charts  (MIX'J  for  troubleshooting  tasks  on  the  ( -141  aiicialt  were  develojied  and  tested.  Ihe 
procedurali/ed  data  were  chaiacteri/.cd  by  short,  casy-to-rcad  instructions,  contained  in  a small, 
pocket-si/ed  book,  that  gave  step-by-step  directions  on  how  to  do  a job.  A large-scale  field  evaluation  was 
conducted.  The  results  indicated  that  inexperienced  mechanics  could  do  non-trouhlcshooiing  tasks  with  no 
errors  with  the  PIMO  data,  f xperienced  mechanics  w'orked  at  a slightly  faster  jrace.  also  w ith  no  errors. 

Further  studies  by  the  Air  Fo.ee  Human  Resources  l.aboratory  (.AMIRI  ) refined  the  I’oimat  lor 
presenting  procedurali/ed  insituclions  and  extended  the  procedurah/ed  concept  to  'elude  coverage  of 
troubleshiKiling  tasks  In  addition.  refmetiK’nls  were  made  to  the  j'rocediires  used  to  develop 
pr<x;cdurali/cd  technical  data.  The  refinements  include  procedures  for  task  identif.  alion  and  analysis, 
matching  training  and  technical  data  requirements,  and  assuring  that  instructions  an  written  at  a level  of 
detail  that  is  appropriate  for  the  intended  user.  Tliese  requirements  and  procedures  arc  siK.ified  in  Joyce, 
('hen/off,  Mulligan,  and  Mallory  (l‘>7.Ja).  For  a description  of  .AMIRI  research  in  this  area,  see  Foley 
(1<J7.J). 

In  l‘)72,  the  .Air  Force  Logistics  Command  (AFl.Cj  initialed  its  Technical  Order  Improvement 
Program  to  replace  the  traditional  FOs  on  selected  older  aircraft.  I'nder  this  j'rograin  procediiridi/ed  job 
guide  technical  orders  for  the  C-141,  B-52.  KC-I3.S,  and  F-KXi  aircraft  are  being  or  have  been  jirocured. 
'fTic  C-141  job  guides  were  the  first  produced  under  this  program.  Recently,  the  Air  Force  lias  directed  that 
j procedurah/ed  job  guides  will  be  priKured  for  orgarii/ational  mairilenaiice  lor  all  new  weajion  systems.  Job 

guides  will  be  procured  for  the  F-16,  A-IO.  the  IJ-I.  and  the  advanced  medium  short  lake-oil  and  landing 
transport  ( AMST) 

Description  of  C-141  Job  (iuides 

Tlic  C-141  job  guide  TO  system  constitutes  a family  of  technical  data  for  all  oii-cqiiipmeni 
maintenance  of  the  C-141  aircraft.  Technical  orders  supporting  iii-shop  work  were  not  changed. 

Althougli  the  complete  family  of  T Os  ls  commonly  called  job  guides,  in  actuality  the  job  guide  is  just 
j one  of  five  distinctive  lyfics  of  maruial  provided.  All  of  Ihe  mainuds  are  presented  in  the  H 1 /4"  by  10  JM" 

format,  except  for  the  job  guide  itself,  which  is  presented  m the  4"  by  8"  formal. 

I Job  guide  lOs  are  generally  characten/cd  by  dear,  concise  mfoniiatiori.  sjiecific  illiislraiions  located 

(near  the  text,  and  llic  use  of  standardi/ed  verbs  to  prevent  confusion.  All  iillornialion  required  to  do  a task. 

such  as  procedures,  lixils,  test  equipment,  personnel,  safety,  etc  are  given  to  reduce  or  eliminate 
i referencing  to  other  T()s.  A sjx-cial  effort  generally  is  made  to  present  instruction  at  the  level  of  detail 

I required  by  the  projected  user. 

j The  job  guide  family  of  TOs  consists  of  the  following  five  kinds  of  data. 

Job  (imJc  Manual  (JCl.MI  Job  guide  manuals  provide  step-by-step  instructions  lor  all  coiiiiiioiily 
performed  tasks  except  Iroublesliooting.  A job  guide  is  provided  lor  each  job.  ITie  job  guide  consists  ol  a 
preliminary  information  page,  one  or  more  pages  of  step-by-step  insiruclions,  and  a lold-oui  j'age  of 
illustrations  showing  the  components  referenced  in  Ihe  insiruclions,  (See  Figures  I and  2 lor  samjile  pages.) 
Tlie  preliminary  information  page  (called  Input  Conditions)  provides  the  technician  with  information  that 
< he  needs  to  begin  the  job.  TTiis  includes  parts  and  supjrlies  requirements,  jvrsonnel  requirements,  and  saleiy 

information.  TTie  input  conditions  page  is  followed  by  step-by-step  instructions  telling  exactly  how  to  do 
1 the  job.  The  instructions  are  written  at  two  levels  of  detail.  Die  general  instiuction  (e  g.,  remove  the  gear 

box)  is  given  in  bold-face  print.  Detailed  instructions  for  accomplishing  Ihe  sub-task  follow  the  bold  face 
instruction.  It  the  technician  is  experienced  and  fully  qualified  on  the  task,  he  may  follow  Ihe  bold-face 
instructions  only.  II  he  docs  not  know  how  to  do  the  task,  the  detailed  instructions  arc  there  to  guide  him. 
The  step-by-step  procedures  arc  (ollowed  by  Uie  fold-out  illustration  page  All  components  referred  to  in 
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Figure  I.  Sample  Job  Guide  Materials. 
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fifrurc  2.  Sample  Job  (luide  Illustrations. 


\ 

llio  insitiiiiions  ;md  ilu'ir  location  on  the  aircratt  arc  illustrated  on  this  page.  Numbered  arrows  are  used  to 
key  the  ilhistTatiori  to  the  instruction,  hor  convenience,  job  guides  are  pnrited  on  4"  by  8"  paper  and 
packaged  in  small,  looseleal  binders. 

\laintc:iaiii  c Su/>i>orr  Injonmtion  Manual  (MSIM).  A maintenance  support  information  manual  is 
used  to  presetit  mlormatioti  which  may  be  reiiuircd  by  the  technician  hut  which  is  mlrenuently  used  oris 
not  appro). Ma'e  lor  presentation  in  the  job  guide  or  troubleshooting  manuals.  It  includes  lists  of  special 
t(H>ls  and  test  equipment,  required  charts,  graphs,  tables  and  statistical  data  which  cannot  be  included  in  a 
job  guide,  and  I'recedures  for  ta.sks  which  arc  infrci|ucnlly  accomphshed  If  the  MSIM  is  required  for  use  on 
a |ob,  the  |ob  guide  will  (in  most  cases)  include  it  in  the  s)iccial  tools  and  equipment  section  of  the  Input 
Conditions  page 

(Icutral  AircraU  Manual  KiAM).  Tlie  general  aircraft  manual  provides  general  information  about  the 
aircraft  which  may  be  rerjuired  by  technicians  or  other  sfiecialists.  It  includes  a description  of  tlic  aircraft 
(including  geneial  arrangements,  dimensions,  station  diagrams,  walkways,  etc.)  and  system  functional 
descripitions. 

Mnnn  IhaKraim  Manual  fW’D.M).  This  manual  provides  diagratiis  of  all  aircraft  wiring  and  drawings 
sliowing  the  location  of  connectors,  ground  points,  tertiiinal  boards,  and  splice  areas.  A coordinate  system  is 
used  with  the  C-141  wiring  diagrams  to  facilitate  location  of  s]ieciljed  wiring. 

h>gic  Tree  TrnnhhMiitoiini;  Auls  (!  iTAj.  Troublesliooting  information  is  presented  in  a logic  tree 
format.  Wlien  troublesliooting  a system,  the  technician  first  identifies  the  malfunction  symptom  by 
tierformiiig  a system  checkout  using  the  checkout  procedure  in  the  job  guide  manual.  He  then  refers  to  a 
I listing  of  malfunction  syinptonis  Hie  listing  of  malfunction  symptoms  can  be  found  in  two  places  — a 

troubleshooting  index  volume  and  at  the  front  of  the  section  of  troubleshooting  jrrocedures  for  each 
symptmri.  Hie  listing  either  sitecilies  the  corrective  action  or  refers  the  technician  to  a troubleshrKiting 
procedure  called  an  action  tree,  file  action  tree  gives  stcjvby-step  insinicitons  for  isolating  the  fault.  Tlie 
rnstructions  are  (rresented  m a logic  tree  format,  flic  outcome  at  each  check  (step)  determines  the  next  step 
to  be  taken.  Hie  tree  is  followed  until  the  cause  of  the  malfunction  is  identified.  Tlie  logic  tree 
, trouhlesh(H)ting  aids  are  sup|iorted  by  illustrations  similar  to  those  provided  with  the  job  guide  manuals. 

Numbered  arrows  are  used  to  key  the  illustrations  to  the  instructions.  For  easy  reference,  the  illustrations 
are  printed  on  fold-out  pages.  For  the  more  complex  systems,  functional  wiring  diagrams  are  also  included 
> with  the  trmiblcsluxiting  priKcdures.  'fliesc  diagrams  follow  the  illustration  page.  (See  Figure  for  sample. 

l.n  A materials.) 

j IX-velopment  of  the  C -141  Job  (iuides 

The  ( -141  job  guide  T()s  were  pnK'ured  by  the  AFT.C  as  part  of  its  Technical  Order  Improvement 
I I’rograni.  Tlie  data  were  produced  under  contract  by  Westingliouse  CorfHrration  in  accordance  witli  a 

I modiried  version  of  Mil -M-.18800A.  Tlie  military  specification,  M1L-M-38800A,  was  modified  by  the 

I addition  of  the  requirement  for  a task  analysis.  Tliis  requirement  was  included  to  insure  that  all  tasks  were 

, identified  and  that  the  procedures  developed  were  accurate  and  effective.  The  requirement  was  included  at 

tlie  request  of  tlie  using  command.  Military  Airlift  ('onimand  (MAC),  with  the  concurrence  of  tlie  procunng 
agency,  Warner  Robins  Air  Ligistics  Center,  Oeorgia. 

Other  features  of  the  job  guide  contract  included  a warranty  on  the  data,  complete  contractor  access 
to  the  aircraft,  and  KX)'’;  “hands-on”  validation  and  verification  of  the  data.  It  is  felt  that  these  features, 
i together  with  a thorougli  task  analysis,  had  a positive  influence  on  the  quality  of  tlie  data  produced. 

I In  addition  to  a task  analysis,  contractor  access  to  the  equipment  and  1009!  “hands-on"  verification 

and  validation,  AFtIRI.  believes  that  a trade-off  between  training  and  the  job  guide  coverage  and  a user 
assessment  process  add  significantly  to  the  completeness  and  accuracy  of  the  data.  Recommended 
procedures  may  be  found  in  Joyce,  (Tien/off,  Mulligan,  and  Mallory  ( NT.^b). 
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Vpproai'h 

Information  about  the  acceptance  and  usability  of  job  guides  was  desired  in  order  to  guide  future 
•fforts  to  develop  and  use  such  improved  technical  data  for  maintenance.  This  type  of  information  is  not 
ivailahle  elsewhere  m the  studies  of  procedurah/.ed  data,  yet  it  is  very  critical  to  the  ultimate  success  of 
inch  a drastically  different  K)  program. 

\ plan  calling  for  a three-phase  approach  was  developed.  Support  for  the  study  was  provided  by  tlie 
Olfice  of  the  Assistance  Secretary  of  Defense  for  Installations  and  l>ogistics  (OASI)  l&l.),  Headquarters  Air 
force  (IIQUSAI  /l  fiV  f/KDPS),  Air  Force  Systems  Command  (AFSC),  Af  LC,  MAC,  and  AI  HRL 

llic  three  phases  of  the  study  required  data  to  be  collected  before  job  guides  were  implemented, 
during  the  implementation  of  the  job  guides,  and  eight  to  ten  months  after  the  implementation  of  the  new 
job  guides.  Sficcifically,  the  three  phases  of  the  study  were; 

I’liasc  I The  purpose  of  this  phase  was  to  collect  attitudinal  data  from  the  user  population  before  the 
job  guides  were  implemented  at  their  base.  A quc.stiunaip«  was  developed  to  collect  the  attitude  data.  The 
quc*stionnairc  contained  a sample  page  out  of  the  job  guide  scries,  along  with  a brief  explanation  about  how 
they  were  to  be  ased.  A series  of  questions  followed  the  sample  page  and  the  explanatory  material. 
Inters’iews  were  also  conducted  with  suiKrvisory  personnel. 

I'luisc  II.  Hie  purpose  of  this  phase  was  to  collect  attitudinal  data  and  identify  problems  encountered 
at  the  time  of  implementation.  This  wa.s  accomplished  by  the  use  of  interviews,  questionnaires,  and 
observation  shortly  after  the  week  of  implementation  at  tlie  bases.  Implementation  problems  and  schedule 
conllicts  forced  a delay  of  this  phase.  Hiase  II  data  were  actually  collected  eiglit  to  ten  weeks  after 
inipleiiieritation. 

I’lmc  III  Hie  purpose  of  the  third  phase  was  to  collect  attitudinal  data  and  observe  progress  on 
resolution  of  problems  after  the  data  had  been  in  use  for  several  montlis.  Tliis  phase  was  conducted 
approximately  eiglit  months  after  implementation  of  the  job  guides.  This  time  period  was  selected  to 
[xmiiit  data  to  be  collected  after  the  job  guide  program  had  stabilized.  It  was  felt  that  early  administrative 
and  usage  problems  would  be  corrected  by  the  time  Riasc  III  started.  User  attitudes  were  also  expected  to 
have  stabilized  by  this  time  period.  Questionnaires,  interviews,  and  job  observation  were  used  to  determine 
u.scr  acceptance  of  the  job  guides  and  to  identify  problems  resulting  from  their  daily  use. 

('•141  JohCiiiide  Implementation 

Hie  job  guides  were  implemented  at  two  MAC  locations,  Oiarleston  Af'B,  SC,  and  Norton  AF'B,  CA, 
poor  to  the  MAC-wide  implementation  in  March  and  April  1976.  Tlie  purpose  of  the  twivphase 
nnpleniontation  was  to  identify  and  correct  errors  and  usage  problems  before  the  job  guides  were 
implemented  at  the  remaining  MAC  bases. 

Tlie  data  contained  in  this  studs  were  gathered  at  Charleston  AFB  and  Norton  AFB  between  June 
1975  and  June  l*i76. 


It.  niASI  I - Bl  I <mi  IMPl  I Ml  NTATtON 

Tlie  objective  ol  Hiase  I was  to  gatlicr  baseline  data  concerning  attitudes  toward  proceduralized 
lechmcal  data  before  job  guides  were  introduced  at  the  two  bases.  Tliese  data  would  then  be  compared  with 
lliase  III  data  to  be  collected  after  the  manuals  had  been  in  use  at  the  bases  for  six  to  eight  months. 

A questionnaire  was  de‘velo|icd  to  collect  the  data  on  the  technicians’  anticipated  reactions  to  the 
J(<Ms  Hie  questionnaire  contained  a typical  page  of  instructions  and  a page  of  illustrations  which 
supported  the  instructions,  explanatory  material  was  provided  to  inform  the  readers  about  the  origin, 
purpose,  and  cxjiccted  use  of  the  job  guides.  Figlit  questions  followed  the  sample  job  guide  materials.  These 
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questions  asked  the  reader  to  consider  the  features  of  job  guides,  and  llien  to  project  how  he  niiglit  feel 
about  using  them  every  day  on  hts  job.  The  questionnaire  is  contained  in  Appendix  A.  Ttie  questions  were 
also  incorporated  in  a second  questiomiaire  to  provide  a basis  lor  a direct  before  and  after  comparison  Hiis 
questionnaire  was  administered  during  Pliasc  111. 

AFlIRl,  personnel  administered  the  questionnaire  at  Charleston  AFB.  SC  and  Norton  AF  B.  CA.  in 
June  1*175.  An  introductory  briefing  explaining  the  project  and  the  assistance  required  from  each  base  was 
presented  to  the  Deputy  Commander  for  Maintenance  at  each  base.  The  AI'MRI  representatives  then 
coordinated  with  llie  Maintenance  Superintendent  and  the  Superintendent  of  each  maintenance  squadron 
to  pjovide  personnel  to  complete  tfie  questionnaires.  Approximately  40  technicians  who  regularly  used 
llight  line  technical  orders  on  the  C-141  aircraft  were  requested  from  each  maintenance  squadron  at 
Charlestown  AFB  and  Norton  AFB.  It  was  requested  that  the  personnel  selected  from  each  of  the  three 
squadrons  at  each  base  be  representative  of  the  grade,  skill  level,  and  Air  Force  specialty  codes  (AFSC)  of 
that  squadron.  Ivach  shift  was  to  be  represented  also.  In  accordance  with  instructions  from  HQ  MAC,  the 
participation  of  the  personnel  was  on  a noninterl'erence  basis. 

A training  room  or  conference  room  was  made  available  in  each  squadron  to  permit  the 
questionnaires  to  be  _irninistered  in  a serni-controlled  environment.  Tlie  maintenance  personnel  reported  to 
the  room  as  scheduled  by  tlieir  squadron.  A short  introductory  briefing  was  given  to  each  group.  Tlie 
briefing  identified  the  AFURl.  personnel,  and  presented  introductory  material  about  the  job  guide 
program.  The  origin  and  purpose  of  the  questionnaire  was  also  explained.  Instructions  were  then  given  for 
completing  the  questionnaires.  Participants  were  instructed  that  names  were  not  to  be  put  on  tbe 
questionnaire,  and  that  there  was  no  time  limit. 

Hie  results  of  the  questionnaire  are  presented  in  Section  V.  Tliey  are  presented  and  discussed  in 
relation  to  the  results  of  the  questionnaire  administered  in  Hiase  III. 

Interviews  were  conducted  with  most  shop  chiefs  and  many  fliglit  line  sujx’rvisors  to  obtain  an 
indication  of  their  feelings  about  the  existing  technical  orders  and  the  proposed  job  guide  system. 
Interviews  were  also  held  witli  several  experienced  technicians  encouniored  at  random  in  the  sliops  or  on 
the  fliglit  line.  Tlie  interviews  and  informal  discussions  with  the  technicians  and  supervisors  revealed  that, 
althou^  they  were  able  to  get  the  job  done  with  the  old  TOs,  they  considered  them  to  be  relatively  poor 
TOs.  Many  of  those  who  have  had  experience  with  the  TOs  for  otlier  aircraft  systems  indicated  that  the 
C-141  TOs  were  among  tlie  poorest  that  they  had  used.  Several  complaints  were  made  against  the  existing 
TOs.  Tliese  included: 

1 . It  is  often  very  difficult  to  locate  required  information  or  procedures. 

2.  Required  information  or  procedures  are  sometimes  missing. 

.T  Information  and  procedures  in  the  TOi  are  sometimes  unclear  and  difficult  to  understand 

4.  Troubleshooting  information  is  often  incomplete  or  inadequate. 

Sample  job  guide  manuals  were  sliown  to  those  interviewed  and  the  job  guide  program  w xs  described 
Althougli  only  three  months  remained  until  implementation  at  Cliarleston  AFB  and  only  four  months  uiiitl 
ir.iplementation  at  Norton  AFB.  few  of  tlie  supervisors  and  officers  had  very  much  knowledge  ol  the 
program.  (Tliose  at  Cliarleston  AFB  were  somewhat  more  knowledgeable  since  the  job  guides  had  been 
validated  there.)  Many  misconceptions  existed  about  wbo  was  to  use  the  data  and  how.  llie  conleni  and 
format  of  the  data  were  not  well  understood  and  many  were  not  aware  of  the  planned  implementatioii 
dates.  The  Field  Training  Detachment  (FTD)  iH’rsonnel,  who  use  T(K  to  teach  C 141  mainlenancc  classes, 
were  not  aware  that  the  official  data  would  change  in  the  next  few  months  until  AFlIRl,  personnel  bnefed 
the  units  at  both  bases.  No  plans  existed  to  provide  tiuining  on  the  use  of  the  job  guides  or  to  base  their 
classes  on  the  new  job  guide  TOs. 

When  shown  the  sample  job  guides,  most  su(H;rvisors  and  technicians  expressed  positive  responses  to 
the  data.  They  generally  liked  the  size,  the  extensive  use  of  illustrations,  and  the  piocedurali/ed  fonnal 
used  for  presenting  instructions.  lieveral  supervisors  indicated  that  they  felt  tliat  the  job  guides  wixild  be 
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very  g(K)(J  for  inexperienced  personnel.  However,  some  expressed  concern  that  highly  experienced 
technicians  may  resist  using  such  detailed  step-by-step  procedures.  Experienced  technicians  also  expressed 
this  concern.  Tins  concern  was  usually  relieved  -vtien  the  dual  level  feature  was  explained.  Supervisors  also 
expressed  concern  tliat  the  small  si/e  of  the  job  guide  manuals  would  make  them  easily  lost  and  that  there 
would  probably  be  a problem  with  tom  pages  unless  the  job  guides  are  printed  on  much  better  paper  and 
placed  in  a better  binder  than  the  sample. 


III.  PHASK  II  - IMPI.FMFNTATION 

The  purpose  of  Phase  II  was  to  collect  data  on  initial  user  reactions  to  the  job  guides  during  the  week 
of  implementation  at  each  base.  Unfortunately,  so  many  problems  were  encountered  during 

implementation  week  at  Charleston  AFB  that  the  job  guides  were  not  used  very  much.  (See  Special 
Problem  Areas  for  a discussion  of  implementation  problems.)  It  was  felt  that  sufficient,  valid  data  could  not 
be  collected  at  this  time.  An  alternate  Pliase  II  data  collection  period  was  selected  - that  of  6 to  8 weeks 
after  implementation. 

The  alternate  Phase  II  data  were  collected  at  each  .ba.se  approximately  six  weeks  after 

implementation.  Tliesc  data  tlien  represent  the  early  learning  period  after  the  initial  exposure  to  the  job 
guide  family  of  TOs.  Tlie  base  jicrsonnel  at  this  time  were  emphasizing  using  the  job  guides  and  identifying 
as  many  errors  as  possible.  The  following  observations  and  user  comments  represent  this  intensive  search  for 
user  problems.  The  many  positive  observations  and  user  comments  also  are  summarized  in  this  section. 

Tlie  findings  arc  presented  under  the  headings  of  user  acceptance  and  usability.  As  defined  in  Section 

1,  user  acceptance  refers  to  the  attitude  of  the  users  toward  the  data.  This  will  be  discussed  in  sections 

identilying  positive  and  negative  acceptance  factors  and  the  impact  each  has  on  the  use  of  the  data. 
Usability  is  a related  term  used  to  identify  factors  which  encourage  or  discourage  the  normal  use  of  the  new 
data  on  the  job 


Acceptance 


Several  factors  influence  the  willingness  of  technicians  to  accept  the  new  technical  data.  These  factors 
are  discussed  m the  following  paragraphs 

Positive  Acceptance  Factors 

Fhe  following  factors  were  found  to  have  a positive  influence  on  the  acceptance  of  the  new  data. 

/ Suf  of  Job  (tuiiJf  Manuals  Witfi  very  few  exceptions,  the  technicians  indicated  that  they  liked 
the  si/e  of  the  manuals  very  much.  Iliey  are  easier  to  carry  and  easier  to  use.  Some  supervisors  suggested 
that  technicians  may  be  iiuhc  wiling  to  use  technical  data  because  it  is  more  convenient.  Other  saw  the 
viiall  si/e  as  a potential  disadvantage  in  that  the  size  will  make  it  too  easy  for  the  books  to  be  lost  or 
inadvertently  carried  away 

2 1‘ruifJurfs  an-  vasy  lt>  read  and  understand  Many  technicians  indicated  that  they  liked  the  clear, 
concise  manner  ui  which  the  books  are  written.  The  writing  is  clearer  than  the  old  TQs,  and  in  many  cases, 
more  thorough  than  the  old  TOs 

3.  I’resentaiion  of  instruct  urns  Most  technicians  hked  the  way  the  instructions  are  presented  in  the 
job  guides.  They  liked  the  input  conditions  page  which  tells  them  how  to  prepare  for  a job,  the  step-by-step 
instructions  which  tell  them  exactly  what  to  do,  references  which  tell  them  where  to  look  in  the  illustrated 
parts  breakdown  (IPH)  for  parts  information,  and  instructions  which  tell  what,  if  any,  follow-on 
maintenance  is  required 

4 Illustrations  Most  technicians  liked  the  job  guide's  fold-out  illustrations  which  are 
keyed  to  the  procedures  Hie  illustrations  show  the  technician  exactly  where  the  component  is  located  on 


the  aircrall  Also,  where  appropnate,  exploded  views  of  the  components  are  provided.  Ilie  job  guide 
manuals  provide  illustrations  of  all  components  relerenced  in  the  procedure  Hie  old  TO  system  did  not 
provide  illustrations  of  all  components,  ('onsequently , it  was  not  uncommon  for  time  to  be  lost  attempting 
to  locate  a given  component.  Time  is  also  saved  by  locating  (he  illustraions  very  near  die  procedure  they 
support  In  the  old  TO  system,  illustrations  were  scattered  througliout  the  manual  and  time  was  lost 
flipping  back  and  forth.  Ttie  quality  of  the  illustrations  in  the  JOMs  and  ITT  As  was  considered  by  most 
technicians  to  be  very  good.  Some  ptxir  illustrations  were  also  identified.  The  poor  quality  of  most  ol  these 
appeared  to  be  due  to  pinir  printing. 

5 . Dual  l.ci'cl  l'rcscntalii)n  A concern  In  the  use  of  the  job  guide  approach  was  that  the  higli  level  of 
detail  would  offend  expenenced  tcdinicians.  To  avoid  this  reaction,  a dual  level  presentation  format  was 
used.  The  format  provides  a general  instruction  printed  in  bold  face  (e.g..  Remove  Connector  Assembly) 
which  IS  followcxl  by  detailed  instructions  (e.g.,  how  to  remove  the  connector  assembly).  To  satisfy  TO  use 
requirements  (as  interpreted  by  MAC)  the  experienced  technicians  (fully  qualified  on  that  task)  need  follow 
only  the  general  instructions.  It  the  technician  docs  not  know  how  to  do  the  job.  the  detailed  instructions 
are  there  to  guide  him  step-by-step.  Tlie  exjK'rienced  technicians  like  the  dual-level  presentation.  It  it  were 
not  for  this  feature,  there  probably  would  be  significant  resistence  to  the  job  guides  on  the  part  of  these 
technicians  It  is  likely  that  they  would  not  accept  the  job  guide  manuals  without  excessive  coercion. 

Negative  Acceptance  Factors 

/.  Hi'siilaiue  to  Chan^f.  Tliere  is  a natural  tendency  to  resist  anything  new  that  alters  one's  normal 
everyday  way  of  doing  things.  This  tendency  was  evident  among  maintenance  [xirsonnel  at  both  (liarleston 
AI  B and  Norton  AFB.  As  would  be  expected,  it  was  most  evident  among  the  more  cxjierienced 
technicians,  especially  the  civilians.  These  personnel  were  thorouglily  familiar  with  the  old  TOs  and  knew 
exactly  where  to  find  what  they  needed.  Ttie  new  data  were  just  something  else  to  get  used  to.  A surprising 
number  of  those  who  expressed  dislike  or  indifference  to  the  data  indicated  tliat  the  problem  was  primarily 
a matter  of  resistance  to  change  and  that  they  will  probably  like  the  data  after  they  used  to  it. 

2.  trmrs  in  the  Data  F.rrors  and  omissions  in  the  data  created  a serious  problem  in  gaining 
acceptance  of  the  data.  For  those  who  were  inclined  to  resist  the  new  data,  errors  provided  a convenient 
excuse  not  to  use  it.  lliere  were  many  errors  in  the  data  However,  the  errot  rate  did  not  appeal  to  be  any 
greater  than  would  be  exjiccted  lot  any  new  K).  Procedures  for  idenlilyiiig  and  correcting  the  errors 
through  the  AFTO  Form  22  system  api^cated  to  be  working.  Tlie  prevailing  attitude  among  most 
technicians  seemed  to  be  that  there  are  errors,  errors  are  to  be  expected,  and  that  they  will  have  to  work 
around  them  until  they  arc  corrected.  AM.C  and  MAC  (xtrsoniicl  were  doing  an  outstanding  job  of 
identifying  errors  and  getting  the  corrections  authorized 

3.  I'rohlvms  in  Implernentation  Problems  encountered  in  introducing  the  data  at  Charleston  AFB 
and  Norton  AFB  may  have  contributed  to  the  reluctance  of  some  to  accept  the  data.  As  cxjiected,  many 
problems  were  encountered  in  introducing  the  data  at  the  two  bases  since  this  represented  the  first  large 
scale  attempt  to  implement  this  type  ol  data  in  an  operational  unit  A major  goal  of  introducing  the  data  at 
these  test  bases  was  to  identify  problems  so  that  they  could  be  avoided  at  other  bases  Some  of  the  major 
problems  which  had  an  impact  on  acceptance  are  discicssed  briefly  below 

a.  A significant  communication  problem  was  encountered.  Tlie  cliain  of  command  was  relied 
upon  as  the  major  means  ol  gelling  information  to  the  working  technicians.  This  approach  did  not  prove  to 
be  completely  effective,  lechnicians  were  found  at  Charleston  AFB  several  days  after  the  data  were 
implemented  who  did  not  know  that  they  were  to  be  using  them  (one  did  not  know  what  they  were). 

h Adequate  instruction  on  the  use  of  the  data  was  not  provided  At  (Ttarleslon  .AFB  the 
primary  training  given  was  a roll  call  briefing  given  by  a Weslinghouse  Corporation  representative.  Tlie 
training  provided  base  information,  hut  was  not  sufficient  to  give  an  adequate  understanding  of  the  system. 
Tlie  job  guides  themselves  are  not  difficult  to  use  Die  problem  was  that  the  technicians  did  not  adequately 
understand  what  is  contained  in  the  other  volumes  (l.T'IA.  MSIM,  WDM  and  GAM)  and  how  to  find  the 
information.  Many  lechnicians  were  not  aware  of  the  other  volumes  or  their  content. 
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c.  Hte  policies  for  use  of  tlie  job  guide  manuals  (primarily  the  dual  level  feature)  were  not 
adequately  explained  to  the  technicians.  Some  tccliniciaris  were  reluctant  to  apply  the  dual  level  aspect 
because  they  were  afraid  that  they  would  be  written  up  by  quality  control  inspectors.  Several  questions 
regarding  the  general  policies  tor  the  use  of  job  guides  were  identified  during  the  early  phases  of  the 
implementation.  I’olicies  had  been  developed  for  most  of  these.  However,  it  could  not  he  determined  that 
these  jiolicies  had  been  specifically  slated  in  official  documents  from  MAC.  Asa  result,  some  uncertainties 
remained  among  maintenance  pessonnel. 

d.  Adequate  provisions  were  not  made  for  storing  the  JGMs  on  the  aircraft.  Initially,  at 
Charleston  Al  l),  the  job  guide  manuals  were  placed  on  the  aircraft  in  a large  cardboard  box.  Tins  procedure 
proved  to  be  entirely  unsatisfactory.  Tlie  manuals  soon  became  jumbled  and  it  became  a very  time 
consuming  task  to  find  a specific  manual.  Tins  tended  to  discourage  use  of  the  job  guide  manuals.  A rack 
for  storing  manuals  on  the  aircraft  has  been  designed.  At  the  time  the  ITiase  II  data  were  collected, 
installation  was  pending  approval  from  MAC.  Tlie  storage  rack  should  alleviate  the  problem.  Norton  AFB 
was  unable  to  obtain  sufficient  job  guide  binders  to  place  them  on  the  aircraft.  Tlie  manuals  were  being 
kept  on  the  various  dispatch  trucks.  Ttiis  approach  was  more  effective  than  the  boxes  used  at  Charleston 
.Af  B.  However,  the  manuals  were  still  not  as  readily  available  as  is  essential  to  encourage  maximum  use. 

UsabQity 


Many  of  the  factors  which  encourage  use  of  the  data  also  encourage  the  users  to  accept  the  data.  The 
followmg  five  factors  discussed  here  were  also  identified  and  discussed  as  positive  acceptance  factors.  This 
discussion,  however,  will  emphasi/.e  the  impact  these  factors  have  on  the  use  of  the  new  data  on  the  job. 

Positive  Usability  Factors 

The  following  were  identified  as  factors  which  encouraged  the  technicians  to  use  the  data. 

1.  Size  oj  the  Job  (iuulc  Mamuih.  Tlie  physical  si/e  and  characteristics  of  the  4"  X D"  format 
encourage  the  worker  to  pick  it  up  and  carry  it  to  the  job  site.  Tlie  small  si/e  and  the  ability  to  lay  flat  and 
open  also  encourage  its  use  in  tlie  often  confining  work  area.  Tlie  traditional  TO  was  larger,  heavier,  more 
bulky,  and  hard  to  carry  and  use  on  the  job.  Tlie  technician  is  more  likely  to  carry  and  use  the  smaller, 
more  readily  available  job  guide  than  he  is  to  leave  the  immediate  work  area  to  go  to  the  aircraft  TO  file  to 
look  up  the  necessary  information  in  the  old,  larger  format  TO. 

2.  1‘roccJiirt’s  arc  case  to  read  anil  understand,  flic  new  data  provides  lor  quick  understanding  of 
what  is  to  be  done.  Die  language  uses  verbs  tliat  have  standard  application  througliout  the  data.  This 
eliminates  one  source  of  confusion,  flie  step-by-step  iiirtructions  are  intentionally  kept  to  the  minimum 
number  ol  words  required  to  convey  the  meaning,  llie  technicians  are  able  to  read  the  step  once  and 
understand  what  is  required. 

f'rcscntation  of  Instructions.  Tlie  completeness  of  the  information  encourages  use  on  the  job.  file 
)ob  guide  contains  all  of  the  information  that  sliould  be  required  to  complete  a given  task.  Tlie  input 
conditions  identify  the  tools,  cquipriK'iit,  spare  parts,  personnel,  and  equipment  conditions  necessary  for 
successful  task  comjiletion.  Step-by-step  instructions  are  keyed  to  accompanying  illustrations  to  provide 
detail  and  liKatioii  inforiiiation.  Reference  information  to  help  locale  any  required  parts  in  tlie  illustrated 
parts  breakdown  is 'given  on  the  illustration  page.  Any  requirement  for  follow-on  maintenahee  is  specified 
and  the  appropriate  reference  given  at  the  end  of  the  task  procedure.  Almost  no  referencing  to  other 
manuals  is  reijuired  to  accomplisli  a given  task. 

4 Illustrations.  Hie  quality  and  quantity  of  the  illustrations  encourage  the  use  of  the  data.  They 
provide  liKation  and  detail  views  of  referenced  components  and  are  fully  keyed  to  the  text.  The 
illustraUons  are  also  located  very  close  to  the  appropraite  page  of  instructions,  and  the  fold-out  feature 
enables  the  use  of  the  illustration  as  if  it  were  located  on  the  page  facing  the  text.  Generally,  the 
illustrations  seem  to  have  tlie  proper  amount  of  detail  to  convey  information  without  confusion. 


5.  I'hujl- Level  Presentation  As  described  in  Section  I,  the  dual-level  presentation  provides  a general 
task  statement  for  use  by  the  experienced  technician,  followed  by  detailed  task  steps  for  the  less 
expenenced  individual.  Kach  job  guide,  then,  provides  adequate  instructions  for  both  the  experienced  and 
inexperienced  technician.  This  feature  encourages  the  experienced  man  to  use  the  technical  data  for  a quick 
review  of  the  steps  of  the  job.  or  of  the  accompanying  illustrations.  The  less  experienced  technician  is 
encouraged  to  use  the  job  guide  because  it  provides  virtually  all  of  the  information  required  to  do  a job 

Negative  Factors  Influencing  Usability 

The  new  C-141  technical  data  is,  for  the  most  part,  easier  to  use  than  the  old  C-141  T(>s.  TTie 
instructions  arc  clearer,  procedures  are  more  complete,  and  illustrations  are  easier  to  use  and  of  belter 
quality.  Tlie  size  of  the  job  guide  manuals  makes  Ihcni  easy  to  use  and  increases  the  likelihrxid  that 
technicians  will  use  technical  data.  Tlie  dual-level  presentation  feature,  as  it  was  being  applied  by  MAC, 
makes  it  easier  for  techriicians  to  satisfy  technical  data  requirements. 

Alihougli  the  new  data  is  much  more  “usable’’  than  the  old  TOs,  a number  of  problems  have  been 
identified  wluch  reduce  their  usability  and  hinder  their  acceptance  by  technicians.  Most  of  the  problems  are 
fixable  provided  that  sufficient  resources  are  made  available  to  make  the  necessary  modilications.  fhe 
negative  factors  identified  in  visits  to  Oiarleston  and  Norton  Air  Force  Bases  arc  discussed  as  follows 

1.  Sumber  of  I'olunies  Required.  TTie  original  job  guide  concept  was  that  all  information  required 
for  a job  would  be  provided  in  one  job  guide  and  that  job  guides  would  be  packaged  to  keep  the  number  of 
volumes  required  for  related  tasks  at  a minimum  This  concept  has  not  been  completely  satisfied  in  the  new 
C-141  data.  The  most  frequently  heard  complaint  at  both  bases  was  that  loo  many  btxiks  arc  required  to  do 
a job.  For  example,  a brake  repair  requires  one  volume  to  bleed  and  refill  the  system,  a second  volume  to 
repair  the  brake,  and  a third  volume  to  operationally  check  the  repaired  brake.  In  some  instances,  an 
additional  volume  (.MSIM)  may  be  required  for  tolerances  and  specifications.  A Iroiibleshixiiing  ia.sk 
requires  as  a minimum  a job  guide  volume  for  the  checkout  procedure  and  a Iroiibleshixiling  volume.  II  the 
logic  tree  troublesliooting  aid  does  not  isolate  the  problem,  the  wiring  diagram  volume  and  the  general 
aircraft  manual  may  be  required.  .Some  tasks  in  the  engine  area  require  use  of  tables  and  charts  sgiecifying 
allowable  nicks  and  required  pressures  and  temperatures.  Ttiiis.  these  tasks  require  the  MSIV1  in  addition  to 
the  job  guide.  Tlie  requirement  for  using  several  hooks  has  proven  to  be  quite  frustrating  to  technicians  in 
specialties  such  as  hydraulics  and  aero  repair  which  work  on  the  entire  aircraft . Tliis  can  he  a problem  when 
the  requirement  for  an  additional  book  is  not  discovered  until  the  technician  is  in  the  middle  I'f  the  job  It 
may  be  that  the  job  guide  volumes  arc  organized  in  the  most  efficient  manner  possible.  However,  the 
frequency  of  complaints  makes  this  an  area  worthy  of  examination.  Hus  problem  should  be  given  special 
consideration  by  Air  Force  agencies  procuring  job  guide  manuals  for  other  weapon  systems. 

2.  Storage  of  the  Data.  Althoiigli  the  small  volumes  arc  convenient  to  use.  the  size  and  tyjv  of 
binder  present  several  problems.  Tlie  size  limitations  on  the  job  guide  manuals  resulted  in  production  of  a 
large  number  of  volumes  The  number  of  volumes  increases  storage  requirements  and  makes  the  job  of 
keeping  track  of  the  volumes  and  preventing  loss  of  the  manuals  a difficult  one.  flie  storage  problem  is 
compounded  by  the  inadequate  binder  used  to  bind  the  job  guides  Tlie  binders  ate  of  the  loose-leaf  tyjw 
with  soft  covers.  The  soft  covers  make  it  difficult  to  stack  the  volumes  on  their  side  or  stack  them  on  end. 
As  a result,  a compartmentalized  storage  rack  will  be  necessary  to  keep  the  volumes  in  a neat,  orderly 
manner. 

3.  Durability.  A problem  has  been  encountered  with  the  pages  tearing  out  of  the  job  guide  manu  ils. 
This  problem  will  become  very  serious  as  the  bixiks  are  used  more  and  pages  become  lost.  Tlie  page  tearing 
problem  seems  to  be  the  result  of  two  primary  factors,  pixir  paper  and  the  hinder.  Tlie  job  guides  arc 
printed  on  ptxir  quality  paper  which  tears  easily.  This  weakness  is  compounded  by  the  rough  edges  on  the 
binding  rings  of  the  notebook-type  binder.  Tliese  tougli  edges  tend  to  tear  the  paper  when  the  pages  are 
turned.  It  appears  that  torn  pages  wfll  be  an  even  greater  problem  with  the  fold-out  illustration  pages  which 
are  not  as  weD  protected  when  in  use.  An  additional  contributing  factor  is  that  most  of  the  pages  have  the 
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holes  punthcd  at  the  vcr>  edge  of  the  page.  Any  sliglit  pressure  is  enough  to  tear  the  page  out.  Also,  the 
guinnied  page  remtoreements  cannot  always  be  used  to  repair  a torn  page  because  the  hole  is  at  the  edge  of 
the  paiXT 

4.  ItlwHratioiv;.  Ihe  overall  quality  of  the  illustrations  is  good.  lloweveT,  some  poor  illustrations 
were  found.  Ihese  illustrations  were  poor,  pmnarily  because  of  the  printing  quality,  not  because  of  the 
content. 

5 lA>catiii!i  1‘micJiircs  Serious  indexing  problems  existed  ui  the  new  technical  data  system  Tliese 
problems  apivared  li'  be  from  two  causes  inadequate  indexes  and  tables  of  contents,  and  inadequate 
understanding  of  the  system  by  technicians.  Many  technicians  and  supervisors  reported  spending  several 
hours  liHiking  for  a procedure  sometimes  with  success,  sometimes  without  success.  I’art  of  the  problem  is 
due  to  the  fact  that  Ihe  index  volume  covers  only  the  job  guide  manuals  Many  technicians  were  unaware  of 
this  and  incorrectly  concluded  that  a proa’dure  does  not  exist  when  in  fact  it  does  exist  but  is  in  the  MSIM 
Others  failed  to  find  a priKedure  because  the  component  involved  was  listed  under  a name  other  than  the 
name  by  which  it  is  commonly  known.  Accessing  information  in  the  data  would  be  greatly  aided  by 
expanding  the  index  to  include  all  procedures,  charts,  diagrams,  etc.,  included  m llie  entire  system.  (As  a 
result  of  this  recommendation,  the  index  has  been  revised  to  cover  the  entire  job  guide  system.)  Althougli 
the  index  itsell  was  inadequate,  it  is  believed  that  the  major  ouslacles  to  locating  information  in  the  new 
data  was  that  the  technicians  did  not  understand  the  system  and  use  of  the  index.  Training  on  IrKating  the 
information  should  be  an  integral  part  of  the  data  implementation  program. 

6.  i.rmn  in  the  ProrcJun'<;.  As  indicated  in  an  earlier  section,  there  were  a number  of  errors  in  llie 
data.  Some  of  the  errors  were  serious  enough  that  if  the  procedure  was  followed  exactly,  the  job  could  not 
be  done,  or  damage  to  equipment  or  personnel  could  result.  Fortunately  most  of  the  personnel  using  the 
data  were  sufficiently  experienced  to  recognize  and  work  around  such  problems.  Heavy  emphasis  on 
identifying  errors  and  excellent  cixiperation  by  MAC,  AIT.C  and  the  contractor  resulted  in  relatively  quick 
correction  of  serious  errors  in  the  data,  llie  first  corrections  were  in  the  field  within  the  first  three  months 
of  the  program.  This  compares  with  the  nonnal  1 2 to  18  months  required  for  updates. 

7.  Ineffective  I'rocedures.  Technicians  complained  that  some  procedures  were  ineffective  or 
inefficient.  Tlie  authors  were  not  technically  qualified  to  evaluate  these  complaints.  However,  ft  was 
recommended  that  consideration  be  given  to  identifying  and  correcting  any  such  procedures.  Common 
complaints  were 

a,  Tlie  checkout  procedures  arc  too  long.  Technicians  say  that  they  frequently  do  not  have  time 
to  complete  the  lengthy  procedures.  Tlicy  also  complain  that  in  soiiu;,  instances  tliey  are  required  to  go 
througli  the  entire  checkout  when  only  a portion  of  Ihe  checkout  would  be  adequate.  They  ask,  “why 
check  out  the  entire  system  after  replacing  a component  when  a few  quick  checks  will  tell  if  the  component 
is  functioning  properly'’”  The  technicians  also  complain  that  many  of  the  quick  checks  used  with  the  old 
TOs  were  not  included,  but  were  replaced  with  the  new,  longer  checkouts. 

b.  Tlie  procedures  require  use  of  tix)  many  danger  tags.  Tlie  technicians  say  tliat  the  procedures 
require  use  of  far  more  danger  tags  than  the  old  TOs.  Tliey  believe  that  many  of  the  tags  are  not  needed  and 
that  wime  are  actually  redundant.  Since  danger  tags  are  a controlled  item,  any  unnecessary  use  of  the  tags 
presents  an  unnecessary  administrative  requirement  and  a substantial  increase  in  maintenance  time. 

8.  OmilteJ  I'rocedures.  Although  the  new  data  cover  many  more  tasks  than  the  old  TOs,  technicians 
report  that  some  tasks  have  been  omitted.  Ihe  authors  did  not  attempt  to  locate  all  of  tliese  procedures.  It 
IS  likely  that  some  procedures  were  in  fact  omitted.  Other  missing  procedures  arc  probably  somewhere  in 
the  job  guides  or  MSIM  and  simply  were  not  found. 

Manpower  Requirements.  Procedures  sometimes  require  more  men  than  are  normally  used  or 
available.  For  example,  the  aircraft  recovery  procedures  require  three  technicians.  F'equently,  when  several 
aircraft  come  in  at  the  same  time,  there  are  not  enough  men  available  to  assign  three  men  to  each  aircraft. 
Supervisors  stated  that  two  men  can  handle  the  job.  They  were  concerned  about  possible  write-ups  for  not 
complying  with  the  requirements  of  Ihe  technical  data. 


10  Inamplett  Thiuhleshootiii}!  Data  Many  coininon  malfunction  indications  were  not  included  in 
the  malfunction  indexes  or  covered  by  troublesboriting  trees  As  a result,  the  troublesltixtting  data  were  not 
fully  capable  of  serving  their  intended  purpose.  It  appeared  that  very  little  use  was  being  made  of  the  logic 
tree  troubleshooting  data  It  was  considered  essential  that  tliese  aids  be  given  sufficient  use  to  at  least 
identify  missing  symptoms  and  errors  In  the  data. 

Special  Problem  Areas 


Two  problems  were  apparent  during  the  Hiase  11  data  gathering  period.  Tlie  first  concemed 
implementation  procedures,  and  the  second  concerned  the  degree  of  utilisation  of  tlie  new  data,  es[JcciaJly 
the  logic  tree  troubleshooting  aids. 

Implementation 

Numerous  problems  were  identified  during  the  first  week  of  implementation  at  Oiarleston  AlTl. 
Much  could  be  said  about  the  problems  of  this  first  week.  Many  classic  problems  common  to  any  new 
program  were  present.  Tlie  difficulty  of  transitioning  a large  group  of  exfiericnced  people  from  one  type  of 
technical  data  to  another  type  was  obviously  underestimated.  Tlie  simplified  procedures  encouraged 
everyone  to  assume  that  the  data  system  would  be  easily  understood.  This  perhaps  could  have  been  true  if  a 
short  introductory  training  session  had  been  provided  to  explain  the  format,  contents,  and  use  of  the  new 
data.  Hus  was  not  done.  The  infonnal  briefings  held  at  shift  roll  calls  proved  to  be  inadequate.  Many 
problems  seemed  to  center  around  the  fact  that  the  user  did  not  know  what  kind  of  manuals  (e.g.,  JGM, 
M.SI.M,  or  GA.M)  contained  what  kind  of  information.  Many  did  not  know  that  any  type  of  manual  but  the 
job  guide  was  even  available.  Tlie  lack  of  an  index  to  the  whole  set  of  TOs  further  confused  tlie  legitimate 
attempts  to  locate  information. 

Another  problem  was  that  many  people  were  not  adequately  informed  about  the  program.  Althougli 
the  officers  and  senior  Nt'Os  generally  were  well  infomied  about  the  project,  the  working  level  technicians 
often  were  confused.  Many  of  the  workers  had  very  little  knowledge  about  the  new  data,  the  test  period 
and  procedures,  and  the  expected  procedures  for  utilization  of  the  data.  Tliis  perhaps  reflects  the  difficulty 
the  shop  supervisor  has  in  getting  all  of  his  people  together  at  one  time  for  any  intensive  briefing  while 
trying  to  support  aircraft  maintenance  on  a 24  hours  a day,  7 days  a week  tiasis.  Because  of  job 
requirements,  extra  duties,  personal  affairs,  and  administrative  requirements,  there  wfll  always  be  some  who 
“didn’t  get  the  word.”  This  observation  further  supports  the  requirement  for  a separate,  sliort  program  to 
provide  introductory  training. 

The  lack  of  an  overall  guiding  policy  or  plan  for  implementation  was  apparent  in  several  ways.  The 
project  monitor  at  Oiarleston  ATB  was  assigned  shortly  before  implementation  and  did  not  have  adequate 
time  to  organize  the  implementation.  Command  leadership  was  available  in  some  areas,  such  as  project 
briefings  to  staffs,  but  was  not  available  in  other  areas,  such  as  written  policies  for  using  the  new  data.  The 
Field  Training  Detachment  (FTD)  of  Air  Training  Command  (ATC),  which  uses  the  official  TO  to  provide 
system-specific  training,  was  not  aware  that  the  TO  was  being  changed.  Many  people  at  base  level  tlioughi 
that  the  program  was  a test  of  the  new  data,  rather  than  a replacement  ol  the  old  data.  Tliisled  people  to 
retain  the  old  TOs  and  use  them  instead  of  the  new  TOs.  A comprehensive  plan  developed  by  the  Command 
Headquarters  personnel  and  coordinated  by  the  bases  could  have  foreseen  some  of  these  problems.  Project 
monitors  could  have  been  identified  and  trained  in  advance  of  implementation.  A training  program  could 
have  been  developed  to  familiarize  users  with  the  data.  Command  policies  and  program  requirements  could 
have  been  provided  in  written  form  to  prevent  misunderstanding.  With  advance  planning,  the  training  could 
have  been  provided  by  the  FTD.  This  would  have  both  provided  the  training  and  involved  FTD  in  the 
program  at  an  early  point. 

As  previously  noted,  these  implenKntation  problems  hindered  the  actual  use  of  the  data  during  the 
first  week.  Some  of  the  problems  were  solved  early  in  the  week,  others  lingered  to  hinder  usage  weeks 
afterward. 
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I'tili/ation  of  Data 


Htc  sfcoiul  problem  observed  early  in  lliase  II  was  a ^reneral  laek  ol  use  of  tlie  new  data.  It  is  felt  that 
the  problems  discussed  previously  had  considerable  impact  on  the  actual  utili/atioii  of  tJie  data.  l or 
example,  the  availability  of  the  old.  lamiliai  KK.  coupled  with  the  lack  of  knowledpe  about  the  new  TOs 
dcscouraged  the  use  ol  the  job  guides  during  tlie  Hist  week  ol  implementation.  TIils  situation  was  improved 
somewhat  by  the  removal  ol  the. old  fOs  Ironi  all  shops,  aircralt  and  vehicles.  Tlie  difficulty  the  users 
exjH’rienced  m hK'ating  inlormation  discouraged  the  use  ol  the  job  giudes,  as  did  the  confusion  over  how 
the  data  was  to  be  used  I ally  in  the  implementation  period,  a heavy  emphasis  was  placed  on  identifying 
the  errors  m the  data  so  that  they  could  be  corrected  quickly  This  emphasis  encouraged  the  users  to  read 
the  job  guides  carelully  and  identify  the  errors  This  same  emphasis,  however,  wxs  not  given  to  the  logic 
tree  troubleshix'tmg  aids.  Very  little  attempt  was  made  to  use  the  logic  trees  dunng  the  confusion  of  the 
lirst  week  ol  implementation  Again,  no  training  had  been  given,  and  very  few  jxiople  understood  how  tliey 
should  be  used.  Also,  some  of  the  lack  ol  use  of  logic  trees  can  be  exphuned  by  the  fact  that  most  of  the 
troiiNeshixiting  assignments  go  to  exjx’nenced  pei'ple.  Rather  than  use  data  they  were  not  lamiliar  with, 
many  technicians  worked  without  TO;  whenever  possible,  using  the  logic  trees  only  when  everything  else 
failed. 

At  the  time  lliase  II  information  was  actually  collected,  some  six  weeks  after  implementation  at  both 
bases,  a noticeable  improvement  had  been  made  iii  die  use  of  the  new  data  on  the  job.  An  extensive  survey 
of  jobs  in  progress  on  the  llight  line  and  in  the  diKks  revealed  that  most  of  the  jieople  used  no  technical 
data  at  all.  However,  several  technicians  were  found  using  the  data,  including  the  logic  trees.  This  increased 
utili/ation,  althoiigli  not  ideal,  represented  the  increased  emphasis  by  management  and  acceptance  of  the 
ilata  by  the  users  Use  of  the  logic  tt  ’es  still  lagged  behind  the  use  of  the  job  guides.  Several  reasons  existed 
for  this  situation  ITiese  included 

I Tlie  technicians  who  generally  were  called  upon  to  do  the  troubleshooting  had  a high  degree  of 
experience  and  confidence  in  their  ability.  Tlieir  approach  seemed  to  be  to  use  technical  data  only  when 
thenr  own  experience  had  tailed  to  locate  the  problem. 

2.  Many  lecbnicians  condemned  tlie  logic  trees  as  being  ptxir  data  witliout  having  used  them. 
Apparently  most  technicians  had  not  used  gtxid  troubleshooting  data,  and  therefore  had  little  confidence  in 
any  troublesliooting  data. 

-T.  In  many  cases,  the  troublesliooting  procedure  was  much  longer  (in  steps  and  time  required)  than 
the  technician’s  own  procedures  based  or.  his  own  exjierience.  Tlie  logic  tree,  therefore,  generally  was  used 
more  when  time  was  not  critical,  or  when  all  other  sources  had  failed. 

4 OITicers  and  sujx’rvisors  seemed  generally  unfamiliar  with  them,  and  apparently  did  not  encourage 
their  use  to  solve  troublesliooting  problems  TTie  resulting  problem  wxs  that  tlie  troubleshooting  data  was 
not  being  adequalch  iewed  in  all  simps  to  identify  errors  and  omissions. 

Disciivsion  and  Keenmmendations 

Aiibougli  lliase  II  identitied  si-veral  problems  with  both  the  data  itself  and  with  the  initial 
implementation  at  ('harlesion  A1  B and  Norton  ATB,  it  was  detemiined  that  the  initial  developnient  and 
utili/aiioti  ol  (141  job  guides  were  successful  Trrors  certainly  were  present  in  the  data,  but  probably  to 
no  greater  cxieni  than  wouhl  be  loiind  in  any  conventional  TO  development.  Considering  the  very  detailed 
slep  by-step  nature  ol  the  job  guides  and  logic  trees,  the  error  rate  probably  is  satisfactory. 

The  imjilenicntalion  ol  the  new  data  at  ( harleston  ATB  and  Norton  ATH  was  not  as  snuxith  as  all 
would  have  wished  it  I be.  However,  it  was  not  unusual  for  unanticipated  problems  to  occur  since  this  was 
the  first  large  scale  apjilication  of  the  job  guide  concept  in  a MAC  operational  unit.  It  simply  was  not 
possible  for  MAC  to  anticipate  and  avoid  all  of  the  problems.  Considering  the  time  constraints  and  the 
resources  available,  MAC  personnel  did  an  excellent  job  of  introducing  tlie  new  data.  Tlte  lessons  learned  at 
Chailcston  Al  B and  Norton  ATB  did  improve  the  implementation  of  the  data  at  the  remaining  MAC  bases 
and  enroutc  fixations. 
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It  sliould  also  he  noted  that  AI  LC,  MAC,  and  the  contractor  responded  favorably  to  the 
recommendations  made  available  to  them  in  December  l‘)75,  and  contained  in  this  report.  Many  of  the 
recommendations  were  adopted;  otliers  were  reviewed  and  changes  were  made  where  possible.  Tfie  most 
important  change  was  the  development  of  a new  index,  in  accordance  with  the  recommendation  contained 
in  the  report  Also,  the  storage  of  the  job  guides  on  the  aircraft  was  improved  with  the  development  of  a 
specially  designed  storage  box.  Several  procedures  were  reviewed  for  manpower  requirements  and 
procedural  efficiency. 

The  special  program  established  by  .AF'IX'  and  MAC  did  an  excellent  job  of  identifying  and  correcting 
problems  tn  the  job  guides.  MAC  also  began  to  emphasize  the  use  of  the  logic  trees  so  tliat  errors  could  be 
hx;ated  and  corrected  in  them. 

The  people  most  concerned  witli  tlie  C-141  job  guide  project  such  as  the  officers  and  senior  NCOs  at 
the  bases,  MAC  headquarters  personnel,  Al-'LC  TO  personnel,  and  AITIRL  personnel,  felt  that  tlie  initial 
implementation  was  an  overall  success,  despite  the  obvious  problems.  It  is  doubtful  tliat  any  new  TO 
program  could  have  survived  the  intentional  scrutiny  of  so  many  individuals  and  groups  any  better  than  the 
C-141  program  did  in  its  first  implementation  period.  Tlie  general  attitude  of  the  users  and  their  supervisors 
and  managers  at  the  bases  remained  positive  and  optimistic  about  tlie  program.  They  were  also  encouraged 
by  the  improvements  in  the  program  authorized  by  MAC,  Af'L.C,  and  the  contractor.  All  signs  indicated 
that  the  job  guide  program  would  have  a positive  impact  on  C-141  equipment  maintenance. 

Based  on  observations  at  Oiarleston  and  Norton  Air  l orce  Bases  and  the  above  analysis,  several 
recommendations  were  made.  Tlie  recommendations  were  presented  as  general  recommendations  applicable 
to  any  job  guide  procurement.  It  was  recognized  that  application  of  some  of  the  recommendations  to  the 
C-141  data  would  not  be  practical  at  the  time.  However,  it  was  hojied  that  as  many  recommendations  as 
possible  would  be  applied  to  the  C-141  program.  Tliese  recommendations  were  made  available  to  MAC  and 
Al'LC  in  December  1975. 

1.  Indexing.  An  effective  indexing  system  was  needed  which  indexes  the  entire  data  system, 
including  job  guides,  maintenance  support  information  manual,  wiring  diagrams,  and  general  aircraft 
manual.  Indexing  should  be  by  both  systems  and  individual  components  or  line  replaceable  units.  When  a 
component  or  system  is  known  by  more  than  one  name,  it  should  be  listed  under  all  names  by  which  it  is 
known.  Other  categorizatkins  sliould  be  used  as  appropriate.  Kxamples  of  the  latter  would  be  listings  of 
tables  of  tolerances  or  specifications. 

2.  Storage.  Suitable  facilities  are  needed  for  storage  of  tlie  data.  The  facilities  sliould  provide 
convenient  access  to  the  data  to  encourage  use.  Development  of  an  adequate  aircrai't  G file  storage  system  is 
essential. 

3.  Improved  Hinder.  A better  type  of  binder  for  job  guides  should  be  found  or  developed.  Tlie 
present  binder  has  a soft  back  which  makes  it  difficult  to  stand  upriglit  for  storage.  Also,  the  rougli  edges 
on  the  binding  ring  tend  to  tear  the  pages.  A binder  is  needed  that  lays  flat  when  open,  does  not  tear  tlie 
pages,  and  has  a hard  back  for  easy  storage. 

4.  On>uping  of  Tasks.  Special  consideration  is  needed  to  insure  that  joh  guides  are  groufied  so  that  a 
minimum  number  of  volumes  are  required  for  a task  or  series  of  related  tasks.  Consideration  sliould  be 
given  to  grouping  checkout  and  troubleshooting  infoniiation  for  a system  in  the  same  volume.  In  most  cases 
in  which  a checkout  procedure  is  used,  a troubleshooting  procedure  will  also  he  required,  lirouping  the 
checkout  prtKedure,  logic  trees,  and  wiring  diagrams  in  one  volume  would  eliminate  the  need  for  using 
more  than  one  book. 

5.  Paper.  It  is  essential  that  at  least  the  frequently  used  job  guide  manuals  be  printed  on  higli 
quality,  tear-resistant,  waterpniof  paper.  Kxpjerience  at  Charleston  and  Norton  Air  l-orce  Bases  clearly 
shows  that  lost  pages  will  be  a problem.  Tlie  use  of  the  more  expensive  paper  may  prove  to  be  cost-efl'ective 
since  loss  of  a page  invalidates  the  entire  manual.  Individual  pages  are  not  replaced. 
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(■>  \Uwi>inu  r Rcqum  mcnt% . Hic  job  guides  specify  the  number  of  personnel  required  for  each  task. 
Since  If  Ls  nof  always  possible  to  assign  the  si'ccificd  number  of  personnel,  supervisors  are  faced  with  a 
possible  write  up  even  fliougti  the  task  can  be  satisfactorily  accomplLsbed  with  the  available  personnel.  A 
method  needs  to  he  developed  to  provide  sufficient  flexibility  to  accommodate  these  contingencies. 

7.  Implementation,  llie  lecliniqucs  ii.sed  to  implement  the  data  at  an  installation  are  very  important. 
It  IS  essential  that  an  effective  plan  be  developed  and  implemented.  tSee  Appendix  F for  guidance  for 
developing  irnplementatioii  plans).  Tlie  following  specific  recommendations  are  based  on  observed  problems 
at  Charleston  and  Norton  .Air  force  Bases.  Iliey  were  made  to  improve  the  irniilementation  of  job  guides  at 
the  remaining  MAC  bases.  Tlie  recommendations,  however,  should  remain  valid  for  any  command  which 
plans  to  replace  exist  mg  l()s  w ith  job  guides 

a.  I’roject  monitors  should  be  as.sigrted  at  each  base  and  enroute  location  long  before 
implementation.  Base  project  mottiiors  should  select  squadron,  branch,  and  work  center  representatives  to 
assist  them  It  is  crucial  that  the  Maintenance  .Sujierintendent  be  knowledgeable  of  and  actively 
participating  in  the  local  imjilementation.  Ilie  project  monitor  from  each  base  should  meet  with 
knowledgeable  project  leaders  to  gam  firsthand  information  about  the  project. 

b Orientation  materials  should  be  prepared  and  made  available  t»i  the  project  monitors.  Tliese 
materials  should  bnefiy  cxjilain  what  the  job  guide  cona'pt  is.  what  it  consists  of,  how  to  use  the  materials, 
and  a suggested  approach  to  base  and  ]iiadron  level  implementation.  Several  short  exercises  to  provide 
practice  in  finding  sjiccific  information  should  also  be  included.  Tliese  exercises  could  then  ne  used  by  shop 
and  sliift  chiefs  to  faniiliari/,c  their  people  with  the  new  TOs. 

c.  Hie  Director  of  Digistics  and  the  Oiief  of  Maintenance  at  each  base  should  he  infoniied  of 
the  position  of  the  ('onimand  lleadiiiiarter’s  Director  of  Digistics  on  the  implementation,  support  and  use 
of  the  job  guides  in  the  operational  environment.  TliLs  sliould  be  done  by  official  correspondence  from  the 
Director  of  Digistics  or  in  a meeting  chaired  by  him,  litis  action  would  insure  solid  support  of  the  job 
guides  at  base  level  and  would  also  answer  key  usage  questions. 

d.  Dreater  use  should  be  made  of  the  base  level  training  capability.  Command  Headquarters 
training  group  sliould  prepare  a short  training  cla.ss  on  the  contents,  uses,  and  advantages  of  job  guides,  liiis 
course  should  then  be  tauglit  to  all  incoming  maintenance  personnel  at  the  bases.  It  should  he  required  of 
all  maintenance  jiersonnel  tincluding  officers  and  senior  enlisted  personnel)  prior  to  implementation.  Tins 
should  be  done  in  addition  to  the  shop  level  emphasis  dLscussed  in  paragraph  7b.  In  all  trainuig  situations 
the  user  should  actually  perform  several  exercises  which  require  him  to  look  up  certain  infonnation  in  the 
job  guides,  the  maintenance  information  support  manual,  the  general  aircraft  manual,  the  troubleshooting 
manual,  and  the  wiring  diagram  manual.  Training  should  also  enipha.si/,e  the  official  command  jiolicics  for 
the  use  of  the  data.  Ilie  concepts  behind  the  new  type  of  data  should  also  be  di.scussed  to  reassure  the 
technicians  that  tlie  Air  force  does  not  consider  them  to  he  too  dumb  to  read  and  learn,  bin  rather  that  it 
IS  cntical  tor  the  less  exjierienced  people  to  be  able  to  perform  more  and  better  maii'.tenance  earlier  in  their 
careers 

e.  Ba.se  level  project  monitors  should  insure  that  all  organi/.ations  impacted  by  the  change  in  TOs 
are  aware  of  the  imjilenientation  plans.  Tlie  f'ield  Training  Detachment  (f'TD),  the  Technical  Order 
Distribution  Office  (Tf)DO),  and  Supply  should  be  kept  infonned  from  the  beginning.  Quality  Control 
personnel  should  be  involved  and  knowledgeable.  (Quality  Control  Inspectors  must  be  fully  knowledgeable 
of  the  job  guide  concept,  contents,  and  usage  policies.  Tliey  can  be  very  instrumental  in  encouraging  the 
proix;r  use  of  the  job  guides,  lire  project  monitor  sliould  insure  that  projicr  jilaniiing  is  done  and  that 
satisfactory  arrangements  are  made  for  storing  the  job  guides  in  the  shops,  in  the  maintenance  vehicles 
where  appropriate,  in  the  aircraft,  and  in  the  docks.  Storage  which  permits  easy  accessibility  and  quick 
identification  of  the  right  manual  is  conducive  to  greater  use.  Monitors  should  also  be  alert  to  problems 
with  binders,  with  missing  or  inairnplete  manuals,  and  with  the  bunching  of  several  manuals  into  one 
binder. 
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f Hie  first  day  of  miptcincntation  is  cntiial  Hio  actual  day  ol  i";;.lemcnlatioii  sliould  be  a 
Tuesday  and  sfiould  be  announced  well  in  advance.  Cliiel  ot  maintenance,  '.(Uadron.  branch,  and  shop  stall 
meetings  should  cmphasi/.c  the  day  of  iniplenientation  the  previous  week.  ( Iiiet  ol  niaiiitenance, 
commander,  officer,  sufrerintendent,  and  shop  chief  emphasis  is  neces,'ary  for  a succes-slul  imjilcmenialion. 
fisage  policies  should  be  clearly  defined  and  discussed  at  all  levels.  Toe  project  monitor  should  check  to 
insure  tfiat  all  locations  have  the  new  T()s  in  place  On  the  Monday  prior  to  inijiicmentation.  all  levels  of 
maintenance  should  insure  that  all  (K'rsoniicl  on  all  sliifts  are  aware  of  the  new  day’s  events.  On  the  day  ol 
implementation,  all  of  the  old  - 2 series  lOs  should  be  removed  Irom  all  locations  It  is  necessary  for  all 
supervisors  to  insure  that  the  new  TOs  are  used  in  all  cases.  Ho|x-fully,  a headquarter's  team  or 
representative  will  be  on  hand  dunng  the  week  of  implementation  to  help  encourage  use  of  the  data  and  to 
help  answer  questions.  Tach  shop  chief  and  line  and  dock  supervisor  must  be  iclively  involved  to  encourage 
use  dunng  this  penod.  It  is  imponant  to  expect  some  problems  to  occur  despite  the  careful  preparations 
Ihfficulties  will  tKciir  as  a technician  tries  to  find  a particular  illustration  and  set  ot  instructions,  or  in 
getting  to  the  proper  checkout  or  troublesliooting  procedure  Su|XTvisory  personnel  slroiild  be  aware  of 
these  potential  problems  and  he  alert  to  as.sist  as  neccs.sary  If  headquarter’s  personnel  are  at  the  ha.se  they 
sliould  be  readily  available  m the  work  areas  to  observe  the  use  of  the  lOs  and  to  assist  as  required  At  least 
one  meeting  should  be  held  at  the  end  of  the  week  of  implementation  Tlie  base  project  monitor  should 
chair  the  meeting  and  all  levels  of  base  project  personnel  sliould  attend  and  he  prepared  to  discuss  the 
problems  which  were  encountered.  Headquarter’s  representatives,  it  available,  sliould  attend  and  sliare 
relevant  items  of  cxfierience  gained  at  otlicr  bases.  Problem  areas  should  be  identified  and  solutions 
recommended.  Continued  officer  and  supervisor  emphasis  is  required  during  the  first  .several  weeks  of 
implementation. 

8.  Jhlines  Jar  f 'se  It  is  essential  that  llie  policies  for  using  job  guide  manuals  be  clearly  sfiecified  in 
official  documents.  Tins  is  es[K'cially  important  with  regard  to  llie  dual-level  presentation  concept.  l*rior  to 
lurther  implemeritaUon  ot  job  guide  manuals,  policies  sliould  be  clearly  specified  at  the  Command  or  Air 
Force  level  and  published  in  official  documentation. 

‘f.  l/igic  Tti’c  lyi'uhleshoaimn  AiJa.  Hie  development  of  logic  tree  troubleshooting  aids  is  jxrhajss 
the  most  difficult  process  in  preparing  the  new  data.  l>ue  to  the  nature  and  purpose  ot  tlicse  aids.it  is  very 
difficult  to  adequately  validate  and  venfy  them.  Therefore,  it  is  essential  that  very  thorougli  quality  control 
procedures  be  used  in  the  tlie  development  of  the  data  to  insure  complete  coverage  of  malfunctions  and 
accuracy  of  tlie  data  It  is  essential  that  tlie  aids  be  as  thorougli  and  accurate  as  possible  before  they  arc 
placed  in  tlie  field.  If  not,  they  will  be  tried  once  or  twice  and.  if  tliey  do  not  work,  tossed  into  tlie  comer. 
Thus,  it  IS  important  that  the  aids  be  given  as  thorougli  a "shake  out"  as  possible  before  implementation.  A 
Sfiecial  program  directed  at  identifying  all  missing  mallunctions  and  insuring  that  the  procedures  isolate  the 
faults  may  be  required  to  msure  that  the  troubleshooting  aids  are  good  before  Command-wide 
implementation. 


IV.  HIIA.Sk  III  - POST  IMPl.l  MKN1  AI  ION 

Phase  III  data  weie  gathered  by  questionnaire,  interview,  and  observation  eight  to  nine  months  after 
the  implementation  of  job  guides  at  Charleston  and  Norton  Al  lfc.  Tlie  purjiose  was  to  detemiine  user 
attitudes  and  problems  after  considerable  exficrierice  had  been  gamed  with  the  new  data.  A week  each  was 
spent  at  Oiarleston  and  Norton  Al  lis  to  observe  the  work  in  progress  on  tlie  fiiglitline  and  in  the  docks. 
vVhere  ever  possible,  observations  were  made  of  technicians  using  the  data  on  a job.  Individual  and  group 
interviews  were  conducted  with  approximately  150  technicians  to  determine  how  they  liked  using  tlie  job 
guides,  what  kinds  of  problems  they  had  using  them,  or,  if  they  did  not  normally  use  them , why  not 

Also  during  tins  week,  a questionnaire  was  administered  to  .114  technicians  from  the  tluec 
maintenance  squadrons  at  both  bases.  As  during  Pliase  I,  the  Maintenance  Superintendent,  the  Job  Ciiiide 
Project  Monitor,  and  the  Superintendent  of  each  squadron  were  tasked  to  provide  the  personnel.  In  keeping 
with  the  noninterference  agreement,  no  sjiecific  mix  of  experience,  grade,  skills  was  rerjucsted.  Instead,  a 
"representative  group”  of  technicians  was  requested. 
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Ttic  results  ol  the  interviews  arid  job  observation  are  reported  in  this  section.  Tlie  results  of  the 
analysis  ol  the  iiuestionnairc  data  are  contained  in  Section  V. 

Ttie  data  collected  during  Pfiase  III  proved  to  bo  very  dilt'iciilt  to  categonre  according  to  user 
acceptance  or  usability  factors  Tins  finding  probably  reflects  that  the  degree  of  acceptability  of  the  new 
data  to  the  user  is  generally  determined  by  the  initial  experiences  each  user  has  with  the  data  Beyond  the 
early  iriiplenientation  period  the  user's  eiiiph;csis  shifts  to  how  well  the  data  meets  his  needs  on  ‘he  |ob. 
Accordingly,  the  lliase  III  data  are  discussed  in  terms  of  positive  and  negative  factors  affecting  usability  and 
acceptance 

Posilive  Factors  Affecting  Usability  and  Acceptance 

Tlie  following  factors  were  most  commonly  identified  by  the  users  as  positive  aspects  of  the  job  guide 
I'rogram, 

1.  Si:c.  The  small  si/e  of  the  job  guides  makes  them  handy  to  carry  and  to  use.  Ihey  are  small 
enough  to  be  carried  with  a tool  hag  and  parts,  and  can  be  taken  into  small,  tight  working  areas.  They  will 
also  he  flat  and  open  for  use.  Some  books  have  been  iiiispla'xd  because  of  si/e,  but  overall,  si/e  is  a very 
positive  factor. 

2.  nirntratinm  Virtually  everyone,  experienced  and  inexperienced,  liked  the  illustrations.  Ttiey 
apparently  support  the  procedures  very  well  Tlie  less  experienced  people  need  the  detailed  illustraiions  and 
the  experienced  often  use  them  to  refresh  themselves  with  a complex  or  unusual  assembly  or  repair. 

,1  f-onnal.  Most  users  liked  the  way  the  information  is  presented.  Tlie  detailed  procedures 
supported  by  gix)d  illustrations  keyed  to  task  steps,  the  completeness  of  data,  and  the  input  conditions 
page  are  all  positive  factors.  Most  users  agreed  that  the  format  makes  the  TO  easier  to  read,  understand,  and 
use,  especially  for  the  inexjiericnccd. 

4,  In/iiii  Conditions  f’aiif.  Tliis  feature  was  approved  by  all  expenence  levels.  It  simplifies  the 
piejiaration  lor  the  job  by  specifying  tools,  test  cc)uipiiient,  spares,  exjieridables,  people,  and  equipment 
conditions  required  for  the  start  of  the  task.  This  is  especially  valuable  to  the  inexjx'rienced  technician. 

5 Ihial  l.cvi  l.  Althougli  not  completely  known  or  well  understood  by  the  technician,  the  dual-level 
approach  is  a positive  acceptance  factor.  Tlie  experienced  technicians  used  the  dual  level  by  reviewing  tlie 
bold-faced  headings  prior  to  starting  the  job.  Ucnerally,  the  more  exiKTienced  technicians  prefer  this  review 
to  being  required  to  follow  each  step  in  sequence.  The  more  exjierienccd  military  and  civilian  technicians 
probably  would  have  been  more  negative  toward  the  job  guides  if  the  dual-level  feature  was  not  availab  le. 

6.  Reading  U'vel  .Almost  no  complaints  were  made  about  the  reading  level  of  the  job  guides.  By  far, 
the  predominant  opinion  was  that  the  job  guides  are  very  easy  to  read,  to  understand,  and  to  follow.  This  is 
more  important  to  the  less  experiena’d  people,  but  even  the  experienced  people  seemed  to  appreciate  the 
ease  of  reading  and  understanding.  With  all  of  the  unnecessary  information  out  of  the  way,  some 
technicians  with  many  years  of  experience  reported  learning  things  about  the  aircraft  that  they  did  not 
know  before. 

Negative  Factors  Affetiing  Usability  and  User  Acceptance 

Tlie  following  were  the  negative  factors  most  frequently  identified  by  the  users  in  the  interview 
sessions.  As  with  the  positive  factors,  there  seems  to  be  very  little  difference  between  user  acceptance  and 
usability  factors  in  the  ofieratiorial  erivnoniiK-nt  after  the  initial  exfHisure  to  the  new  data, 

Tlic  findings  of  the  interviews  and  observation  of  jobs  in  progress  in  ITiase  III  indicated  tliat  many  of 
tlie  same  problems  that  had  been  previously  identified  in  Phase  II  were  still  present.  The  miqor  problems 
identified  are  dtscussed  as  follows 

1 lack  of  Familiarity  with  the  Job  Guide  Series.  Far  tcHi  many  users  were  still  not  aware  of  or  very 
familiar  with  the  (iAM,  M.SIM,  or  l.TTAs.  In  several  cases  the  technicians  did  not  know  that  the  manuals 
gven  existed.  Most  technicians  did  not  know  what  kind  of  information  is  contained  in  these  manuals.  This  is 
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unforlunatc  lor  two  reasons  (a)  they  cannot  take  advantage  of  tfic  information  contained  there,  and  (b) 
since  they  cannot  locale  some  information  that  they  need  in  a job  guide,  they  complain  that  it  is  not 
available  when,  in  fact,  it  may  be  in  tlie  MSIM  or  (JAM.  Tliis  problem  stems  from  the  inadequate 
implementation  training  and  impacts  botli  user  acceptance  and  usability. 

2,  Confusion  (her  I'rofX’r  (isaf;c  of  Job  Guides.  Tliere  appeared  to  be  no  clear  understanding  of  how 
MQ  MAC  or  the  local  Ouality  Control  inspectors  expected  the  Job  Guides  to  be  used.  Opinions  varied  from 
“I'.veryonc  has  to  follow  every  step,"  to  “Tlie  book  just  has  to  be  in  the  immediate  work  area."  HO  MAC 
had  recently  made  some  additional  efforts  to  clarify  this  issue.  Hopefully,  the  most  recent  messages  have 
clarifjed  the  MAC  policy  on  usage  requirements  and  procedures.  The  new  index,  wliich  was  just  being 
distributed,  has  a section  on  how  to  use  the  job  guides.  Tliis  should  help  inform  all  of  the  users  about  the 
proper  use  of  job  guides. 

}.  Iruuieqiujic  Storage  of  Job  Guides  on  Aircraft . Tliis  item  was  rioted  as  a major  problem  area  in 
Riase  11.  It  was  still  a problem  area  in  Hliasc  111,  altliougti  much  progress  had  been  made.  Since  Pliase  II,  a 
storage  shelf  had  been  designed,  approved,  and  installed  in  the  first  aircraft  at  Cliarleston  Af  B.  Additional 
shelves  were  being  made  as  quickly  as  tlie  material  became  available.  Tliis  shelf  is  designed  to  hold  all  of  the 
job  guide  nianual  senes,  and  should  alleviate  this  problem. 

4.  Ia'SI  or  .Misplaeiti  Job  Guides.  Several  complaints. were  received  about  not  being  able  to  locate  the 
required  job  guide  on  the  aircraft.  Sometimes  these  books  were  later  found  in  an  unlikely  or  inaccessible 
area  of  the  aircraft,  in  anotlier  aircraft,  in  individual  tool  boxes,  or  in  a maintenance  vehicle.  One  job  was 
observed  being  done  without  the  TO  because  the  particular  job  guide  required  was  missing  from  the 
aircraft.  Tliis  problem  creates  hardsliips  for  the  home  station  specialists  and  transient  aircraft  maintcn;uice 
crews  who  must  work  on  tJie  aircraft.  It  also  creates  an  additional  workload  for  the  Organi/aiional 
Maintenance  Squadron  Technical  Order  Monitor,  who  is  responsible  for  keeping  the  aircraft  files  current 
and  complete.  HQ  MAC  is  currently  considering  die  future  status  of  the  aircraft  TO  file,  fievcral  suggestions 
have  been  made,  including:  (a)  delete  the  aircraft  TO  file  entirely,  (b)  eliminate  all  but  the  servicing  and 
ground  handling  TOs,  and  (c)  remove  the  specialist  job  guides  when  the  aircraft  returns  to  the  home  station. 
The  authors  understand  the  desire  to  remove  the  job  guide  file  wholly  or  in  part  from  the  aircraft.  It  is 
likely,  however,  that  utilization  of  the  TOs  will  be  reduced  if  the  entire  file  is  not  readily  available  on  the 
aircraft.  Wliatever  the  eventual  solution  is,  some  way  must  be  found  to  provide  more  control  over  the 
aircraft  job  guide  file. 

5.  Use  of  Danger  Tags.  Danger  tags  are  required  to  be  hung  in  conspicuous  locations  wlxmever 
certain  jobs  are  accomplished  on  the  aircraft.  Tlie  danger  tajs  arc  to  inform  specialists  that  work  is  in 
progress  on  a given  system,  and  to  protect  the  worker  from  unexpected  dangers,  such  as  power  on,  moving 
control  surfaces,  etc.  Tlie  job  guides  specify  when  and  where  tags  should  be  used.  In  some  cases,  as  many  as 
18  danger  tags  must  be  hung  before  work  can  begin.  I>ariger  fags  are  controlled  items,  and  must  be  obtained 
and  filled  out,  then  hung  in  the  proper  locations.  This  adds  considerable  time  and  irritation  to  tlie  job. 
Supervisors  say  that  so  many  danger  tags  are  not  really  necessary  for  safe  maintenance  in  most  cases.  They 
did  not  use  as  many  danger  tags  with  the  old  TOs  which  were  not  as  six’c-ific  in  stating  danger  tag 
requirements. 

6.  lengthy  Checkout  Pnicedures.  Technicians  complained  that  most  of  the  checkout  procedures  are 
too  long,  and  that  they  check  out  more  of  the  system  than  is  necessary  in  some  cases  (such  as  following 
replacement  of  a component).  They  also  said  that  the  old  short,  or  “quick”  checks  previously  in  the  old 
TQj  arc  not  in  the  job  guides.  They  feel  that  tlie  long  checkouts  are  too  time-consuming  to  use  in  a 
time-critical  situation. 

7.  TYouhieshooting  Data  is  Often  /ntvmplete.  The  troublcsliooling  data  appeared  to  be  used  more 
frequently  than  at  the  time  of  the  Pliasc  II  data  collection  in  November  l‘)75.  Many  technicians,  however, 
were  found  who  had  used  the  troubleshixiting  data  very  little,  or  not  at  all.  Tlie  most  common  complaint 
was  that  the  data  does  not  contain  all  of  the  possible  malfunctions.  A few  minor  complaints  indicated  some 
problems  with  understanding  and  following  specific  troubleshooting  steps.  Supervisors  were  encouraging 
technicians  to  use  the  troubleshooting  data  so  that  problems  could  be  found  and  the  data  improved. 
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H.  I.ocating  Spcnfu-  Inlonnation  is  Often  DiJJlcnlt.  Users  still  reported  dirficulty  in  locating 
specific  mforination  or  task  data.  Iliis  is  compounded  when  the  desired  data  are  located  in  the  (iAM  or 
MSIM  (biHiks  with  w hich  most  technicians  arc  not  familiar).  A new  index  had  been  developed  and  was  just 
being  made  available  in  the  field.  Tliis  new  index  contains  all  data  that  is  in  the  new  TOs,  including  the 
UAM  and  MSIM.  llie  new  index  also  contains  an  introduction  section  which  discusses  the  content  and 
usage  of  the  complete  job  guide  series  TOs.  Tlie  new  index  should  eliminate  the  problerh  of  locating  data, 
and  hopelully.  it  will  also  reduce  the  confusion  concerning  content  and  usage  of  the  new  job  guides. 

‘I.  Too  Many  Hutks  are  KcquireJ  to  do  a Job.  Tliis  remained  the  most  common  complaint  about 
the  job  guides.  .Although  this  complaint  was  heard  most  often  in  the  hydraulic  and  aero  repair  shops,  other 
sho(is  also  Voiced  the  same  opinion.  Apparently,  up  to  three  bmiks  may  be  required  for  troubleshooting, 
repair,  and  checkout  of  some  systems  (c.g..  brakes).  Tliis  necessity  to  get  the  additional  bixiks  irritates  tlie 
users,  even  if  the  books  arc  on  the  aircraft.  If  the  user  must  rctuni  to  the  shop  or  wait  for  tlie  maintenance 
truck  to  come  around,  much  time  and  patience  are  lost  Most  users  say  they  would  like  everything  in  one 
lxiok.  Tliis  would,  however,  result  in  a large  and  bulky  bixik  in  some  cases.  Tlie  si/e,  wciglit.  and  failure  to 
lie  flat  and  open  for  use  would  probably  result  in  more  disadvantages  than  advantages.  .A  review  of  the 
hydraulic  and  aero  repair  job  guides  was  recommended  to  insure  that  they  are  organized  in  the  most 
efficient  way. 

10.  Irrtirs  Many  complaints  were  received  about  errors  in  the  bixiks.  Many  errors  had  been 
identified  and  turned  in  for  correction  and  update.  As  the  changes  are  incorporated  in  the  books,  the 
ainiplaints  about  errors  will  diminish.  Tlie  successful  MAC  and  AF-'LC  emphasis  on  kvating  the  errors  in 
books  made  everyone  very  aware  of  errors.  'Die  books  and  the  errors  have  been  scrutinized  so  closely  tfiat 
the  number  of  errors  is  probably  overemphasized. 

1 1.  Resistance  to  Change.  More  technicians  were  slowly  becoming  accustomed  to  the  job  guides  and 
tliereforc  liked  them  better.  Others  still  said  that  they  expect  to  like  them  better  when  they  become  more 
familiar  with  them.  Again,  it  seemed  to  be  the  civilian  force  tliat  most  strongly  opposed  the  job  guides. 
TTiey  were  so  laniiliar  with  the  old  TOs  that  they  resented  having  to  learn  the  new  system,  tven  in  this 
group,  however,  there  was  a noticeable  improvement  in  the  general  acceptance  of  the  job  guides.  Young 
airmen  who  have  worked  only  with  the  job  guides  generally  liked  them  very  well. 

12.  Ourahihtv.  As  a result  of  ITiase  II,  it  was  reported  that  there  was  a problem  of  pages  tearing  out. 
Tins  problem  increased  wiili  the  additional  usage.  Tlie  ring  binder  used  with  tlie  job  guides  deteriorates  with 
the  heavy  and  often  rougli  use  that  they  get  on  the  lliglit  line.  In  time  the  rings  become  out  of  line  and 
catch  and  tear  the  pages  as  they  are  turned.  Tliis  is  compounded  by  the  fact  that  the  holes  are  punched 
close  to  the  edge  of  the  paper,  and  tlie  paper  tears  easily.  As  the  binders  continue  to  deteriorate,  the 
maintenance  and  update  of  tlie  job  guides  will  increase  the  work  load  of  tjje  TO  monitors.  At  the  same 
time,  the  missing  pages  will  force  technicians  to  waste  valuable  time  looking  for  a complete  job  guide  or  to 
do  the  job  without  proper  technical  data. 

Discussun 

It  may  appear  that  very  little  progress  was  made  in  the  seven-month  interval  between  Phase  II  and 
Phase  111.  Many  of  the  same  problems  identified  in  Ptiasc  II  were  still  present  in  Hiase  III.  This  is  true 
because  most  of  the  pmblern  areas  are  such  that  additional  money,  personnel,  or  tnne  would  be  required 
for  solution.  Such  problems  as  the  ring  binder,  paper  quality,  lengthy  procedures,  etc.,  would  be  very  costly 
to  correct.  Some  of  the  otliers,  sucli  as  the  need  for  greater  familiarity  witli  the  data,  aiuld  be  corrected. 
However,  a long  lead  time  would  be  required  to  correct  most  problems. 

Some  very  important  improvements  were  made,  however.  Tlie  new  index  was  just  beginmng  to 
become  available.  This  improved  index  was  a result  of  user  problems  identified  in  lliase  II,  and  is  very 
similar  to  the  recommendations  developed  and  given  at  tliat  time.  An  increase  in  data  usage  w»  noted  in 
Phase  III  as  compared  with  Hiase  II.  This  was  true  for  both  dix'k  and  fliglitline  environments,  and  for  both 
job  guides  and  logic  trees.  The  extent  of  TO  usage  still  remains  a problem,  however,  in  that  the  more 


procedurali/ed  data  are  used,  the  greater  impact  it  should  have  on  the  accuracy,  thoroughness,  and  safety  of 
maintenance.  Tlic  reluctance  of  technicians  to  use  any  kind  of  10  voluntarily  is  not  a problem  which  is 
unique  to  MAC  or  to  procedurali/cd  data.  Hie  remaining  confusion  over  content,  location,  storage,  and  use 
of  the  manuals  undoubtedly  contributes  significantly  to  the  less-than-optimiim  ase  of  the  new  data.  While 
storage  of  the  data  on  the  aircraft  still  remained  a problem  at  the  time  of  Pliase  III,  lliis  problem  should  be 
solved  by  the  new  storage  rack  which  was  just  beginning  to  he  installed  on  the  C-I4I . 

MAC  and  AFl.C  have  put  greater  emphasis  on  improving  the  accuracy  of  the  logic  trees.  Most  shops 
had  an  active  program  to  thorou^ly  review  and  use  the  logic  trees  so  that  errors  could  be  found  and 
corrected.  This  emphasis  should  have  the  same  positive  ef  fect  on  the  long-term  accuracy  of  tlic  logic  trees  as 
it  has  had  on  the  job  guides.  Greater  utilization  of  the  logic  trees  can  be  expected  when  their  accuracy  and 
completeness  is  improved. 

A greater  degree  of  acceptance  of  the  new  data  was  found  in  ITiase  111,  particularly  among  the  civilian 
workers.  This  was  apparently  due  to  an  increased  familiarity  with  the  data,  and  an  increased  use  of  the 
dual-level  feature.  Tliis  feature  allows  the  qualified  technician  to  review  the  major  task  headings  in  the  job 
guide,  and  to  continue  the  task  without  following  the  detailed  task  steps.  Tliis  feature  seemingly 
encouraged  the  higfily  ex[>cricnccd  civilian  workers  to  use  the  data  to  a greater  extent. 

Most  of  the  shop  supervisors  interviewed  spoke  well  of  the  concept  and  potential  of  the  job  guides. 
They  recognized  the  problems,  especially  tlie  errors  and  sometimes  lengthy  checkout  prix;edures,  but 
overall  they  indicated  that  the  job  guides  were  much  better  than  the  original  TOs.  Hie  officers  and  senior 
NCOs.  almost  without  exception  were  optimistic  about  the  long-range  impact  of  tlie  job  guides  upon  C-141 
aircraft  maintenance. 

.Many  recommendations  made  as  a result  of  the  Hiase  11  findings  had  already  been,  or  were  in  the 
process  of  being  implemented.  Althougli  some  discontent  with  the  data  certainly  was  present,  the  majority 
of  those  interviewed  preferred  the  new  data  to  the  old.  The  potential  of  the  C-141  job  guides  to  impact 
maintenance  favorably  probably  is  limited  more  by  administrative  policies  for  its  use  on  the  job  than  by 
any  known  problem  with  the  data  itself. 


V.  yi)l-STI()NNAIRK  RhiSULTS 

In  order  to  supplement  the  infomiation  obtained  through  informal  observation  and  interviews,  the 
Job  Guide  Ouestionnaire  I Appendix  B)  was  administered  to  technicians  at  Charleston  and  at  Norton  AFBs 
The  questionnaire  pmvided  a standardized  means  of  collecting  data  anonymously  from  a large  sample  of 
technicians.  If  was  hoped  that  tlie  anonymity  would  encourage  freer,  more  candid  responses  to  the 
questions. 

Tlie  questionnaire  consisted  of  M questions  (d6  multiple-choice  and  one  open-ended  essay)  designed 
to  measure  atbtudes  and  opinions  relative  to  the  acceptance  and  usability  of  JGMs  and  I TT As.  Included  in 
the  multiple -choice  questions  were  eight  questions  from  a different  questionnaire  ( Appendix  A;  Technical 
fJrder  (>iestionnaire)  which  had  been  administered  to  technicians  before  implementation  of  die  JGMs  and 
LTTAs.  These  questions  were  used  to  provide  a basis  for  comparison  of  attitudes  toward  JGMs  and  I TTAs 
before  and  after  the  guides  were  implemented. 

The  Job  Guide  Questionnaire  was  designed  specifically  for  this  study  to  determine  technicians’ 
attitudes  after  they  had  worked  with  JGMs  and  l.TTAs.  It  was  administered  approximately  eight  inondis 
after  the  job  aids  were  implemented.  The  Technical  Order  Questionnaire  was  designed  primarily  for  a 
replication  of  an  earlier  study  to  measure  technicians’  attitudes  toward  conventional  TOs  and  to  identify 
attitudmal  changes  since  196.V  The  eiglit  questions  pertaining  to  JGMs  and  LTTAs  were  included  in  that 
questionnaire  to  pmvide  data  on  the  technicians’  attitudes  toward  the  job  guide  type  of  data.  A description 
and  sample  pages  of  the  new  job  guides  were  included  in  the  TO  questionnaire  preceding  the  job  guide 
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questions.  The  questions  asked  the  tcehnicians  to  indicate  how  they  thoujjit  they  would  feel  about  the  new 
guides,  based  ujxin  the  information  provided.  Tlic  Technical  Order  Ouestionnaire  was  administered  to 
technicians  approximately  tour  months  before  implementation  of  the  JCiMs  and  LTTAs.  Only  the  results 
for  the  ciglit  questions  pertaining  to  JOMs  and  l.TTAs  are  discussed  in  this  report.  The  results  for  the 
remainder  of  the  TO  questionnaire  will  be  summari/ed  In  another  report. 

Both  questionnaires  were  administered  to  techniaans  at  Norton  and  at  Cliarleston  At  Bs  according  to 
the  same  procedures.  Because  parsonnel  could  participate  in  the  study  only  on  a noninterference  basis,  It 
was  not  possible  to  obtain  completely  stratified  samples  of  technicians.  However,  it  was  believed  that  the 
samples  obtained  were  approximately  representative  of  the  maintenance  population  of  both  bases  I'ach 
maintenance  scjuadron  was  asked  to  provide  approximately  40  to  50  technicians  representative  of  the 
squadron  in  terms  of  AT'.SCs,  grade  levels,  and  cxircrience  levels  to  complete  each  questionnaire.  Ttie 
questionnaires  were  administered  in  training  classrooms  under  seniicontrolled  conditions.  Before 
rcs[X)nding,  the  technicians  were  briefed  on  the  purpose  of  the  questionnaire.  They  were  also  encouraged  to 
resfxmd  with  wntten  comments  in  addition  to  the  multiple-choice  responses  provided  on  the  questionnaire. 
No  collaboration  on  answers  was  permitted  among  technicians.  No  time  limit  was  imposed  dunng  the 
administration  of  the  questionnaires. 

The  data  obtained  with  the  questionnaires  was  summari/ed  by  determination  of  die  percentage  of 
technicians  who  selected  each  response  alternative  to  each  multiple-choice  question.  It  was  observed  that 
there  were  some  significant  differences  m attitudes  between  specific  categories  of  maintenance  personnel, 
nierelorc,  the  results  were  tabulated  and  grouped  by  technician’s  grade,  squadron,  skill  level  and  Al'SC,  as 
well  as  by  each  base  and  by  the  total  sample  from  both  bases.  Ilie  results  for  each  category  of  technicians 
arc  presented  in  Tables  I througli  .V  Table  I presents  the  results  foi  questions  1 through  56  by  base  and 
squadron.  Table  2 presents  the  results  for  the  questions  by  grade  and  skill  level,  and  Table  .5  presents  the 
results  by  ATSC.  Due  to  the  nature  of  the  essay  question,  it  was  not  possible  tosummari/.e  the  results  by 
percentages.  Ihcrefore,  the  essay  responses  are  discussed  separately  after  the  discussion  of  the 
multiple-choice  results. 

The  mam  purpose  of  the  study  was  to  answer  two  basic  questions,  fa)  “To  wliat  degree  were  the 
JtiMs  and  1.TTA.S  accepted  by  maintenance  iX’rsonncT’”,  and  (b)  “To  what  degree  did  maintenance 
personnel  consider  the  JGMs  and  LI  T As  to  he  usable  ’"  llie  report  primarily  discusses  the  results  obtained 
from  the  total  sample  of  technicians.  However,  significant  variations  from  those  results  by  sirecific  groups 
of  technicians  arc  also  discussed 

Tahk  I.  Percentage  of  Subject  Responses,  by  Base  and  by  Sq\iadron, 
to  Kach  Question  of  the  Job  Guide  Questionnaire 


Bam  Squadron 


Quasllont 

C AFB 

NAFB 

Both 

AMS 

FMS 

OMS 

1.  How  do  you  like  the  Job  Guide  Manuals’’ 

a. 

Completely  satisfactory 

1 1.1 

8.1 

').6 

5.9 

8.5 

14.5 

b. 

Ciood,  but  could  be  improved 

68.0 

70.2 

69.1 

70.5 

77.8 

59.1 

c. 

.Satisfactory,  but  no  better  than  the 
old  TOs 

15.7 

1.5.7 

14.7 

15.8 

8.5 

20.0 

d. 

Unsatisfactory 

4.6 

6.8 

5.7 

7.9 

5.7 

5.7 

e. 

Other,  or  multiple  response 

0.0 

0.6 

0.5 

0.0 

0.9 

0.0 

(. 

No  response 

0.7 

0.6 

0.6 

0.0 

0.9 

1.0 

Table  1 (Continued) 


QuMtfont 


BaM  Squadron 


CAFB  NAFB  Both  AMS  FM5  OMS 


Tile  a/e  of  the  Job  fiuide  Manual  is 


a. 

Too  small 

10.5 

10.6 

10.5 

7.4 

13.0 

10.5 

h. 

Too  big 

1..? 

2.5 

1.4 

3.0 

1.0 

1.4 

c. 

Okay 

62.H 

53.4 

58.0 

64.4 

50.4 

54  1 

d 

Just  riglit 

25.5 

33.5 

24i> 

24.8 

35.2 

28.6 

c 

Other,  or  multiple  response 

0.0 

00 

0.0 

0,0 

0,0 

0,0 

f 

No  response 

0.0 

0.0 

0.0 

0.0 

0,0 

0.0 

13ie  illustrations  are 
a.  Ixcelleiit 

22. 

22.4 

22.6 

25.7 

24.1 

18.1 

b 

Poor 

13.7 

14.4 

14.3 

4.4 

20.4 

12.4 

c. 

Okay 

63.4 

62.1 

62.7 

64.4 

55.6 

68.6 

d. 

Other,  or  multiple  response 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

e. 

No  response 

0.0 

0.6 

0.3 

0.0 

0.0 
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I3o  die  job  guide  procedures  contain  all  the 
inromiatiori  you  need  to  do  the  job'’ 
a.  Yes,  for  all  jobs 

5.2 

3.7 

4.5 

4.0 

5.6 

3.8 

b. 

Yes,  for  most  jobs 

37,‘) 

31.1 

34  4 

31.7 

417 

24.5 

c. 

Some  information  is  missing,  but 
guides  are  still  useful 

4S4 

54  0 

51  J 

54.5 

41.7 

58.1 

d. 

Missing  information  makes  job  guides 
unusable 

7.H 

1 1.2 

4.6 

4.4 

10.2 

8.6 

e. 

Other,  or  multiple  response 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

f. 

No  response 

0.7 

0.0 

0.3 

0.0 

0.4 

0.0 

Are  the  prcKedures  correct'’ 
a.  Almost  always 

36.6 

32.3 

.34  4 

33.7 

33.3 

36.2 

b. 

Mostly 

58.2 

64.6 

61.5 

61.4 

63.0 

60.0 

c. 

Seldom 

5.2 

2.5 

3,8 

5.0 

2.8 

3.8 

d. 

Never 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

e. 

Other,  or  multiple  response 

0.0 

0.6 

OJ 

0.0 

0.4 

0.0 

f. 

No  response 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

6.  [>)  you  have  any  ditTiculty  in  understanding 


the  procedures'’ 


a. 

Always 

0.0 

1.2 

0.6 

1.0 

0.4 

0.0 

b. 

Mosdy 

1.3 

3 1 

4.0 

1.4 

I.O 

c. 

Occasionally 

60  8 

61,5 

61.2 

44.5 

62.0 

71.4 

d. 

Never 

37.3 

33.5 

35.4 

45.5 

33.3 

27.6 

c. 

Other,  or  multiple  response 

0.7 

0.0 

0.3 

0.0 

0.4 

0.0 

f. 

No  response 

0.0 

0.6 

0.3 

0.0 

0.4 

0.0 
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Table  I (Omtinucd) 


QuAfttioni 

CAFB 

Bam 

NAFB 

Both 

#MS 

Squadron 

FMS 

OMS 

7 

Arc 

a. 

too  many  bcxiks  required  to  do  one  job'’ 
Always 

5.2 

5.0 

5.1 

5.9 

7.4 

1.9 

b 

Mostly 

3.‘) 

12.4 

8.3 

6.9 

9.3 

8.6 

c. 

Occasionally 

.56.2 

48.5 

52.2 

49.5 

44.4 

62.9 

d. 

Never 

.34.6 

34.2 

.34.4 

37,6 

38.9 

26.7 

e 

Other,  or  multiple  response 

0.0 

0.0 

0.0 

o.q 

0.0 

0.0 

r. 

No  response 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

8. 

l>i  you  find  the  priKcdures  in  the  job  guides 
to  be  loo  simple  (too  detailed)'’ 
a.  Yes,  for  most  jobs 

1^)0 

1 1.8 

15.3 

20.8 

10.2 

15.2 

b. 

Yes.  for  some  jobs 

.32.7 

28.6 

.30.6 

30.7 

23.2 

38.1 

c. 

No,  about  right  for  most  jobs 

47.7 

58.4 

5.3.2 

46.5 

65.7 

46.7 

d 

Other,  or  multiple  response 

0.0 

1.2 

0.6 

2.0 

0.0 

0.0 

e. 

No  response 

0.7 

0.0 

0.3 

0.0 

0.9 

0.0 
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I)o  you  use  the  dual-level  feature'’ 
a.  Mostly 

11.1 

8.7 

9.9 

7.9 

11.1 

10.5 

b. 

.Seldom 

15.7 

14.3 

15.0 

19.8 

10.2 

15.2 

c. 

Wliat  is  the  dual-level  feature'’ 

72.6 

75.2 

73.9 

70.3 

77.8 

73.3 

d. 

Other,  or  multiple  rcsjronse 

0.0 

0.6 

0.3 

0.0 

0.0 

1.0 

e. 

No  response 

0.7 

1.2 

1.0 

2.0 

0.9 

0.0 

10. 

Have  you  had  any  problems  with  lost,  torn, 
or  dirty  TO.  pages'’ 
a.  Yes,  a lot 

15.7 

32.9 

24.5 

26.7 

15.7 

31.4 

b. 

Some 

37  _3 

26.7 

31.9 

22.8 

35.2 

37.1 

c. 

Very  little 

26.1 

16.2 

21.0 

25.7 

26.9 

10.5 

d. 

No 

20.‘» 

24.2 

;!2.6 

24.8 

*>'>  *> 

21.0 

e. 

Other,  or  multiple  response 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

f 

No  response 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

11. 

Do  you  use  the  procedure  headinj$  as  a 
checklist'’ 
a Frequently 

24.2 

29.8 

27.1 

14.9 

32.4 

33.3 

b 

Sometimes 

59.5 

45.3 

52.2 

60.4 

50.0 

46.7 

c. 

Never 

16.3 

22.4 

19.4 

22.8 

15.7 

20.0 

d 

Other,  or  multiple  response 

0.0 

0.6 

0.3 

00 

0.9 

0.0 

e. 

No  response 

0.0 

1.9 

1.0 

2.0 

0.9 

0.0 

12. 

Would  you  prefer  to  use 
a.  Traditional-style  TOs 

21.6 

18.6 

20.1 

20.8 

22.2 

17.1 

b 

Job  Guide-style  TOs 

58.8 

48.5 

53.5 

43.6 

64.8 

51.4 

c. 

Checklists 

12.4 

22.4 

17.5 

22.8 

7.4 

22.9 

d. 

No  TOs 

6.5 

5.6 

6.1 

6.9 

5.6 

5.7 

e. 

Other,  or  multiple  response 

0.7 

4.4 

2.6 

5.0 

0.0 

2.9 

f. 

No  response 

0.0 

0.6 

0.3 

1.0 

0.0 

0.0 
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Table  1 iConiinucJ) 


13.  What  is  the  best  feature  of  the  Job  (iuidcs? 


a. 

Siie 

27.5 

30.4 

29.0 

23.8 

23.2 

40  0 

b. 

Simplicity 

20J 

15.5 

17.8 

27.7 

16.7 

9.5 

c. 

.Step-by-step  procedures 

28.8 

29.-2 

29.0 

27.7 

35.2 

23.8 

a. 

DIustrations 

10.5 

4.4 

7.3 

6.9 

6.5 

8.6 

e. 

Dual -level  of  instructions 

0.7 

1.9 

IJ 

1.0 

0.9 

1.9 

f. 

Other  or  multiple  response 

12.4 

18.0 

15.3 

12.9 

16.7 

16.2 

g- 

No  response 

0.0 

0.6 

0.3 

0.0 

0.9 

0.0 

I>> 

a. 

fold-out  pages  make  tiic  illustrations'’ 
Very  convenient  to  use 

22.2 

25.5 

23.9 

20.8 

24.1 

26.7 

b. 

No  problem  to  use 

58.2 

55.9 

57.0 

63.4 

59.3 

48.6 

c. 

Difficult  to  use 

17.7 

17.4 

17.5 

14.9 

14.8 

22  9 

a. 

Other,  or  multiple  response 

13 

0.6 

1.0 

1.0 

0.9 

1.0 

e. 

No  response 

0.7 

0.6 

0.6 

0.0 

0.9 

1.0 

The  illustrations  are 

a.  Necessary  to  complete  most  jobs 

2 

8.1 

8.6 

10.9 

7.4 

7.6 

b. 

Helpful  for  most  jobs 

58.2 

59,6 

58.9 

33.7 

72.2 

69  5 

c. 

Helpful  but  usually  not  necessary 

32.0 

31.1 

31.5 

55.5 

18.5 

21.9 

a. 

Not  needed  for  any  job 

0.0 

0.6 

0.3 

0.0 

0.9 

0.0 

e. 

Other,  or  multiple  response 

0.7 

0.6 

0.6 

0.0 

0.9 

1.0 

f. 

No  response 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

The  index  is 
a.  Very  helpful 

47.7 

47.2 

47.5 

34.7 

57.4 

49.5 

b 

Usually  helpful 

47.1 

50.3 

48.7 

64.4 

38.9 

43.8 

c. 

Other,  or  multiple  response 

3.3 

1.9 

2.6 

1.0 

1.9 

4.8 

a. 

No  response 

2.0 

0,6 

1.3 

0.0 

1.9 

1.9 

How  useful  IS  the  GAM'* 
a.  Very  useful.  Used  frequently 

7.2 

9.9 

8.6 

6.9 

10,2 

8.6 

b. 

■Somewhat  useful.  Used  occasionally 

37,9 

29.2 

33.4 

29.7 

35.2 

35.2 

c. 

Seldom  useful.  Rarely  used 

14.4 

14.9 

14.7 

18.8 

11.1 

14.3 

a 

Have  never  used  it 

36.6 

43.5 

40.1 

42.6 

39,8 

38.1 

e. 

Other,  or  multiple  response 

0.0 

0.6 

0.3 

1.0 

0.0 

0.0 

f. 

No  response 

3.9 

1.9 

2.9 

1.0 

3.7 

3.8 

As  a source  of  infonnation  for  your  job,  the 
new  job  guide  manuals  are 
a.  Much  better  than  the  old  TOs 

16.3 

11.8 

14.0 

9.9 

14.8 

17.1 

b. 

Better  tlian  the  old  TOs,  but  can  be 
refined 

53.6 

57.1 

55.4 

57.4 

59.3 

49.5 

c. 

No  belter  than  the  old  TO 

18.3 

18.6 

18.5 

16.8 

15,7 

22.9 

a. 

Worse  than  the  old  TOs 

10.5 

11.8 

11.2 

15.8 

8.3 

9.5 

e. 

Other,  or  multiple  response 

0.7 

0.0 

0.3 

0.0 

0.9 

0,0 

f. 

No  response 

0.7 

0.6 

0.6 

0.0 

0.9 

1.0 
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Tabic  I iConlinia  J) 


Bam 

Squadron 

Qu«ttioni 

CAFB 

NAFB 

Both 

AMS  FMS  OMS 

I'J.  (>)  you  feci  Uial 

a.  Vou  use  JGMs  more  than  the  TOs'’ 
b About  the  same  as  the  old  TOs'’ 

c.  Less  than  the  old  TOs’’ 

d.  Other,  or  multiple  response 

e.  No  response 

20.  How  valuable  do  you  dunk  the  Job  Guides 
arc  to  OJ'T’ 

a.  Valuable  — much  better  than  the  old 
TOs 

b.  Valuable  — about  die  same  as  the  old 
TOs 

c.  Of  little  value  - about  the  same  as  the 
old  TOs 

d.  Of  no  value  - much  worse  than  the 
old  TOs 

e.  Other,  or  multiple  response 

f.  No  response 

21.  /V>  an  OJT  tramer,  Job  Guides  are: 

a.  Very  valuable  - much  better  than  the 
old  TOs 

b.  Valuable  — about  the  same  as  the  old 
TOs 

c.  Oi  little  value  — about  the  same  a.s  the 
old  TOs 

d Of  no  value  — much  worse  than  the 
old  Tf)s 

e.  Other,  or  multiple  response 

f.  No  response 

22.  Does  use  of  Job  Guides  allow  less 
experienced  technicians  to  do  more  jobs? 

a.  Yes 

b.  No 

c.  Other,  or  multiple  response 

d.  No  response 

2.J.  Would  you  recommend  that  JGMs  be 
purchased  for  use  in  your  shop’’ 

a.  Yes,  for  all  tasks 

b.  Yes,  for  some  tasks 

c.  No 

d.  Other,  or  multiple  response 

e.  No  response 


J3.3 

51.6 

13.7 
0.0 
1.3 


S2,‘> 

25.5 

13.1 

6.5 

0.7 

1.3 


44.4 

33.3 

11.1 

6.5 

0.7 

3.^) 


43.8 

51.0 

1.3 

3.9 


32.0 

50.3 

14.4 
0.0 
3.3 


37.3 

44.7 

16.8 
0.6 
0.6 


47.2 

35.4 

13.0 

3.7 

0.0 

0.6 


41.0 

33.5 

12.4 

3.1 

0.0 

9.9 


44,7 

49.1 

1.2 

5.0 


34.2 

53,4 

11.8 

0.0 

0.6 


35.4 

48.1 

15.3 

0.3 

1.0 


50.0 
30.6 

13.1 

5.1 

0.3 

1.0 


42.7 
33.4 

1 1.8 

4.8 

0.3 

7.0 


44.3 

50.0 

1.3 

4.5 


33.1 
51.9 

13.1 
0.0 
1.9 


23.8 
58.4 

16.8 
1,0 
0.0 


59.4 

23.8 

10.9 

SM 

0.0 

0.0 


51.5 

26.7 

13.9 

4.0 

0.0 

4.0 


44.6 

53.5 

1.0 

1.0 


29.7 

56.4 

13,9 

0.0 

0.0 


48.2 

42.6 

7.4 

0,0 

1.9 


47.2 

33.3 

13.0 

4.6 

0.0 

1.9 


44.4 

32.4 

9.3 

5.6 

0.0 

8.3 


46.3 

47.2 

0.0 

6.5 


40.7 

45,4 

12.0 

00 

1.9 


33.3 

43.8 

21.9 
0,0 
1.0 


43.8 

34.3 

15.2 

4.8 

1.0 

1.0 


32.4 
41.0 

12.4 

4 8 
1.0 
8.6 


419 

49.5 

2.9 

5.7 


28.6 

54.3 

13.3 
0.0 
3.8 
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Tabic  1 (CinmnucJ) 


Squadron 

Qu««tlont 

CAFB  NAFB 

Both 

AMS  FMS  OMS 

24. 

WiHild  ytHJ  recoimnend  that  l.TTAs  be 
purchased  for  use  in  your  shop? 
a'.  Yes,  for  all  tasks 

25.5 

31.7 

28.7 

29.7 

31.5 

24.8 

b.  Yes,  for  sonic  tasks 

54.3 

53.4 

53.8 

53.5 

50.0 

58.1 

c.  No 

15.7 

12.4 

14.0 

16.8 

13.0 

12.4 

d.  Other,  or  multiple  response 

0.7 

0.0 

0.3 

0.0 

0.0 

1.0 

e.  No  response 

3.d 

2.5 

3.2 

0.0 

5.6 

3.8 

25. 

The  new  JGMs  and  LTTAs  help  you  do  your 
job? 

a.  Better 

47.1 

45.3 

46.2 

47.5 

49.1 

41.9 

b.  About  the  same 

46.4 

48.5 

47.5 

43.6 

44.4 

54.3 

c.  Not  as  well 

4.6 

5.0 

4.8 

8.9 

3.7 

1.9 

d.  Other,  or  multiple  response 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

e.  No  response 

2.0 

1.2 

1.6 

0.0 

2.8 

1.9 

26. 

Do  you  like  having  detailed  step-by-step 
instructions  such  as  those  found  m the 
JGMs? 
a.  Yes 

60.8 

69.6 

65.3 

58.4 

74.1 

62.9 

b.  Makes  no  difference 

29.4 

25.5 

27.4 

29.7 

21.3 

31.4 

c.  No 

7.8 

2.5 

5.1 

10.9 

2.8 

1.9 

d.  Other,  or  multiple  response 

0.0 

1.2 

0.6 

1.0 

0.0 

1.0 

e.  No  response 

2.0 

1.2 

1.6 

0.0 

1.9 

2.9 

27. 

Do  you  like  having  detailed  illustrations 
keyed  to  the  step-by-step  procedures'* 
a.  Yes 

65.4 

75.2 

70.4 

65.4 

77.8 

67.6 

b.  Makes  no  difference 

27.5 

22.4 

24.8 

29.7 

17.6 

27.6 

c.  No 

5.2 

0.6 

2.9 

5.0 

2.8 

1.0 

d.  Other,  or  multiple  response 

0.0 

0.6 

0.3 

0.0 

0.0 

1.0 

e.  No  response 

2.0 

1.2 

1.6 

0.0 

1.9 

2.9 

28. 

Which  type  of  technical  data  would  you 
prefer  to  use?  For  routine  jobs 
a.  Traditional  10 

1 1.8 

14.3 

13.1 

13.9 

13.0 

12.4 

b.  Checklist 

30.7 

36.0 

33.4 

34.7 

26.9 

.39.1 

c.  Job  Guide  Manuals 

39.2 

34.8 

36.9 

31.7 

46.3 

32.4 

d.  Very  general  procedures 

14.4 

7.5 

10.8 

12.9 

1 1.1 

8.6 

e.  Other,  or  multiple  response 

2.0 

6.2 

4.1 

6.9 

0.9 

4.8 

f.  No  response 

2.0 

1.2 

1.6 

0.0 

1.9 

2.9 
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Table  1 {Continued) 


Queitto  nt 


Base  Squadron 


CAFB  NAFB  Both  AMS  FMS  OMS 


Tor  non  roiilinc  jobs 


a 

I raditional  TO 

1K..J 

26.1 

22.3 

28.7 

21.3 

17.1 

b. 

Cbecklisl 

‘).K 

10.6 

10.2 

7.0 

5.6 

17.1 

c. 

Job  (lUide  Manual 

bl.4 

54.7 

58.0 

56.4 

65.7 

51.4 

d 

Very  general  instructions 

5.2 

6.2 

5.7 

4.0 

6.5 

6.7 

c. 

Other,  or  multiple  response 

2.b 

1.0 

1 1 

.3.0 

0.0 

3.8 

T. 

No  response 

2,6 

0.6 

1.6 

0.0 

• 0.0 

3.8 

How 

do  you  feel  about  being  ret|uired  to  use 

J(iMs  tor  cver>'  job'* 

a. 

■leased 

1 l.H 

14..3 

13.1 

7.0 

18.5 

12.4 

b. 

Mostly  pleased 

28.1 

.30.1 

.3.3.8 

20.7 

44.4 

26.7 

c. 

Somewhat  irritated 

40.5 

34.2 

37.3 

37.6 

20,6 

44.8 

d. 

Irritated 

15.7 

10,6 

1.3.1 

22.8 

5.6 

1 1.4 

c. 

Other,  or  multiple  response 

0.7 

0.6 

0.6 

1.0 

0.0 

0.0 

f. 

No  respsmse 

.T..T 

1.2 

T S 

1.0 

0.0 

4.8 

Wliicb  would  be  the  most  helptui  to  you  in 
transferring  to  a new  aircraft? 

a 

ATC  school 

0.7 

3.1 

1.0 

1.0 

1.0 

2.0 

b. 

TTI)  school 

26.1 

31.1 

28.7 

22.8 

33.3 

20.5 

c. 

OJT 

11. i 

.30.8 

.38.5 

44.6 

33.3 

38,1 

d. 

JfiMs  and  l.TI  As 

15.0 

6.8 

10.8 

13,0 

11.1 

7.6 

e. 

Conventional  if) 

5.2 

2.5 

3.8 

5.0 

3.7 

1.0 

1. 

Other,  or  multiple  response 

12.4 

14.3 

1.3.4 

0.0 

14.8 

15.2 

K- 

No  response 

3..J 

2.5 

2.0 

2.0 

1.0 

4.8 

Wtiich  do  you  believe  would  most  improve 
the  efficiency  of  maintenance  ojx-rations'’ 

a. 

More  ATC  training 

.3.0 

6.2 

5.1 

5.0 

3.7 

6.7 

b 

Better  ATC  training 

0.2 

8,1 

8.6 

7.0 

5.6 

12.4 

c. 

Better  conventional  TOs 

0.8 

0.3 

0.6 

8.0 

0.3 

10,5 

d. 

Jf.Ms  and  l.TTAs 

.30.1 

13.7 

21.7 

22.8 

25  0 

16.2 

e. 

More  qualil'ied  personnel 

27.5 

28.6 

28,0 

30.7 

T)  S 

31.4 

f 

Better  supply  support 

7.8 

10.3 

13.7 

1 1.0 

21.3 

7.6 

g- 

Other,  or  multiple  response 

0.2 

13  0 

112 

1 1 0 

10  2 

1 1.4 

h. 

No  response 

2.6 

1.0 

■>  ■> 

1.0 

1 0 

3.8 

Total  Number  of  Respondents  Per  Category  = 

15.3 

161 

314 

101 

108 

105 

Table  I {ContmucJ) 


Base 

Squadron 

Qutstlont 

CAFB 

NAPB 

Both 

AMS  FMS  OMS 

33. 

you  prefer  to 

a. 

Use  l.TfA.s  for  all  tioubicshooting 
tasks 

15.5 

22.7 

19.2 

14.9 

21.3 

28  0 

b. 

Use  LTTAs  for  infrequent 
troublesfiooting  tasks  only 

2H.2 

26.7 

27.4 

27.0 

31.9 

20.0 

c. 

Use  LTTAs  for  the  most  difficult 
troubleshooting  tasks  only 

32.4 

34.7 

33.6 

29.7 

36.2 

40.0 

d. 

Develop  own  troubleshooting  strategy 
and  not  use  LTTAs  at  all 

22.5 

13.3 

17.8 

25,7 

8.5 

12.0 

c. 

Other,  or  multiple  response 

1.4 

2,7 

2.1 

2.7 

2.1 

0.0 

M. 

How  do  you  feel  about  being  required  to  use 
t.TTAs  for  all  troubleshooting  jobs’’ 

a. 

Pleased 

14.1 

16.0 

15.1 

9.5 

17.0 

28.0 

b. 

Mostly  pleased 

25.4 

36.0 

30.8 

20.3 

44,7 

36.0 

c. 

Somewhat  irritated 

35.2 

34.7 

34.9 

37,8 

29.8 

36.0 

d. 

Irritated 

25.4 

13.3 

19.2 

32.4 

8.5 

0.0 

e. 

Other,  or  multiple  response 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

35. 

Do 

LTTAs  lead  to  correct  isolation  of  the 

problem’’ 

a. 

Yes,  always 

4,2 

6.7 

5.5 

2.7 

6,4 

12.0 

b 

Usually 

46.5 

52.0 

49.3 

419 

63.8 

44.0 

c 

Sometimes 

40.H 

33.3 

37.0 

41.9 

25.5 

44  0 

d 

Seldom 

8.5 

8.0 

8.2 

13  4 

4.3 

0.0 

c. 

Other,  or  multiple  response 

0.0 

0,0 

0,0 

0.0 

0.0 

0.0 

36 

Ix» 

I TT  As  require  more  or  less  time  to 

lroublcsli(K)t  a problem’’ 

a. 

less  time  is  required  using  ITT  As. 

19.7 

32.0 

26  0 

20.3 

29  8 

36.0 

b 

About  the  same  amount  of  time 

45.1 

37  3 

411 

40.5 

44.7 

.36,0 

c. 

More  time  is  required  when  using 
LTTAs 

32.4 

29,3 

30.8 

39.2 

25,5 

16.0 

d. 

Other,  or  multiple  response 

2.8 

1.3 

2 1 

0.0 

0.0 

12.0 

Total  Number  of  Respondents  Per  Category  = 

71 

75 

146 

74 

47 

2.-> 

Nol«.  — l>uc  to  space  limiutions,  i\w  qucstH»ns  prrsented  in  the  tables  have  been  abbreviated.  The  questions  are 
presented  in  their  complete  ohtpnal  form  in  the  questionnaires  in  the  appendix. 

(.^estions  16  were  answered  only  by  tln»se  trehnuuns  surveyed  wlio  had  used  l.TTAs. 


Tahlv 


PiTCfiilagf  of  Subject  Responses,  by  (irade  and  by  Skill  Level, 
to  Kach  Question  of  the  Job  Guide  Questionnaire 


Grad#  Skill  Leval 


Quastlont 

2 

3 

4 

s 

6«.7CiB 

10i.1t 

3 

5 

7ii9 

1. 

Ho\s  do  you  like  ihc  Job  (pukIc  Manuals’,’ 
a.  ( oinpletcly  salisf.ielory 

16.7 

12.1 

0 

H..5 

0.0 

7.5 

9.1 

11.2 

6 1 

b (iood.  but  eould  be  improved 

7.1  0 

6K.2 

70.5 

66.7 

64  ^ 

6(5.5 

72.7 

69.3 

67  1 

u Satislactory.  but  no  belter  than  the 

old  ros 

K..1 

15.2 

1.5.2 

16  7 

2K.6 

14.6 

15.6 

15.7 

17.1 

d.  Unsalistaclor) 

0.0 

4.6 

4.4 

5.6 

7 1 

9.8 

4 6 

4,9 

8.5 

c.  Other,  or  multiple  response 

0.0 

0.0 

1 1 

0.0 

0.0 

0.0 

0.0 

0,5 

0.0 

1.  N»o  resf'oiist* 

0.0 

0.0 

11 

2 K 

0.0 

0 1) 

0 0 

0.5 

1.2 

■> 

The  si/e  ol  the  Job  (iuide  Manual  is 
a loo  small 

0.0 

9.1 

H.H 

K.5 

14.5 

17.1 

0.0 

10.2 

15  4 

b Too  bij? 

4.2 

1.5 

.5  .5 

0.0 

7.1 

0.0 

4.6 

2.0 

1.2 

c.  Okav 

4.S.H 

b5  2 

5 5.9 

55.6 

64  5 

59.15 

50.0 

57.1 

65.4 

d.  Just  right 

50.0 

24.2 

14.1 

56.1 

14.5 

25  2 

45,5 

,50.7 

22.0 

e.  Other,  or  multiple  respimse 

0.0 

0.0 

0.0 

0.0 

0,0 

0.0 

0,0 

0.0 

0.0 

t.  No  respfinse 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0,0 

0.0 

0.0 

\ 

The  illustrations  are 
a.  1 xeellcnt 

12.5 

24  2 

20.9 

14.5 

25  2 

22.7 

22.4 

24.4 

h.  P.x.f 

12.5 

1 .5.6 

15.2 

11.1 

14.5 

IS  5 

18.2 

12.7 

17.1 

c.  ()k,iy 

75.0 

62.1 

64  i- 

55.6 

71  4 

5S.5 

59.1 

64  4 

58.5 

d.  Other,  or  multiple  response 

o.O 

0.0 

0.(. 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

e.  No  response 

0.0 

0.0 

1.1 

0.0 

0.0 

0.0 

0.0 

0.5 

0.0 

4. 

Do  the  job  guide  procedures  aoitain  all  the 
intorrnation  >a>u  need  to  do  the  job? 
a.  Yes,  for  all  jobs 

4.2 

6 1 

5.5 

-S.6 

■5.1 

1.2 

4.6 

4 4 

4.9 

b.  Yes.  lf>r  most  jobs 

50.0 

27.. 1 

40.7 

.50.6 

2«,6 

50.5 

40.9 

55.2 

55  4 

k Some  inlfirmatitjn  is  missing,  but 

guides  are  still  useful 

41.7 

56  1 

46.2 

50.0 

64.5 

54.9 

50.0 

51.7 

51.2 

d.  Missing  information  makes  job  guides 

unusiible 

4.2 

lO.b 

7.7 

1.5.9 

0.0 

12.2 

4 .6 

10.7 

7.5 

c.  Other,  or  multiple  response 

0.0 

0.(1 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

f No  response 

0.0 

0.0 

0,0 

0.0 

0.0 

1.2 

0.0 

0.0 

1.2 

5. 

Are  the  procedures  correci’.’ 
a.  Almost  aUuys 

45. H 

3(t..J 

519 

.56.1 

50.0 

54,2 

45.5 

54.2 

52,9 

b Mostly 

50.0 

65.2 

64.8 

61  1 

50.0 

59.8 

50.0 

62.0 

62.2 

Seldtim 

4.2 

4 .f) 

2_2 

2.K 

0.0 

6.1 

4 6 

5 4 

4.9 

d.  Never 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0,0 

0.0 

e.  Other,  or  multiple  response 

0.0 

0.0 

1.1 

0.0 

0.0 

0.0 

0.0 

U.S 

0.0 

1.  No  response 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.1) 

Dtj  you  have  .my  difficulty  in  understanding 
the  pr<K«lures? 
a.  Always 

0.0 

0.0 

2 2 

0.0 

0.0 

0.0 

0.0 

1.0 

0.0 

b.  Mostly 

4.2 

6 1 

2 2 

0.0 

0.0 

0.0 

9.1 

2 4 

0.0 

i.  Occasionally 

6 V6 

55.0 

55.6 

42  9 

64.6 

72.7 

61.0 

57.5 

d.  Never 

12.5 

.01.. 5 

4(‘."^ 

44  4 

57.1 

52.9 

18.2 

55.1 

41.5 

e.  Other,  or  multiple  rcsp<mse 

0.0 

0.0 

0 II 

0.0 

0.0 

12 

0.0 

0.0 

1.2 

1.  No  res[H>nse 

0.0 

0.0 

0 0 

0 0 

0.0 

1.2 

0.0 

0.5 

0.0 

7. 

Are  to«)  many  Utoks  refjuired  to  do  f>ne  job’’ 
a.  Always 

0.0 

.5.0 

5.5 

5.6 

7 1 

7.5 

0.0 

5.4 

6.1 

b.  Mostly 

0.0 

6 1 

8 8 

2.« 

7 1 

14.6 

0.0 

7 8 

1 1.0 

i.  Ociaiionjllv 

70  H 

4H.5 

49.5 

515.5 

64  5 

47.6 

65  6 

49.8 

54.9 

d.  Never 

29.2 

42  4 

.56.. 5 

55  5 

21.4 

50.5 

56.4 

57.1 

28,1 

e.  Other,  or  multiple  resjumse 

0.0 

0.0 

0.0 

0.0 

0,0 

0,0 

0.0 

0.0 

0.0 

f.  No  rtspf»nsi‘ 

0.0 

0.0 

0.0 

0.0 

0.0 

0,0 

0.0 

0.0 

0.0 
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Tabic  2 {Continued) 


Grad* 

Skill  Laval 

Qu««t<on« 

2 

3 

4 5 

6*7&t  10411 

3 S 749 

8 


10. 


II. 


12 


13. 


14. 


15. 


0(1  you  find  the  proecdurev  in  the  job  jiukIcs 
to  be  l(X)  ample  (lixi  detailed)’’ 


a 

Yes.  tor  most  jobs 

0.0 

21.2 

12.1 

19.4 

14.3 

17.1 

9.1 

15.1 

15  9 

b. 

Yev  for  v*mc  jobs 

41.7 

28  8 

25  3 

30.6 

35.7 

32.9 

.36.4 

27  8 

36.6 

c. 

N<».  about  rijihl  for  iTH»st  jobs 

58.3 

48.5 

615 

50.0 

50.0 

48.8 

54.6 

56.1 

46  3 

d. 

Other,  oi  muliipk'  response 

0.0 

1.5 

II 

0.0 

0.0 

0.0 

0.0 

1.0 

0 (1 

c. 

No  R'sponsc 

0.0 

0.0 

0.0 

0.0 

0.0 

1.2 

0.0 

0.0 

12 

!>(»  you  use  ihc  dual  lcvx*!  feature? 
a.  Mostly 

0.0 

3.0 

1 1.0 

5.6 

7 1 

19.5 

0.0 

9 3 

13.4 

b. 

Seldom 

8.3 

7.h 

14.3 

16.7 

42.9 

17.1 

13.6 

1 1.7 

2.3.2 

c. 

Wtuf  IS  the  dual-level  feature'’ 

01.7 

87.9 

74.7 

77.8 

50.0 

59.8 

86.4 

78.5 

59.8 

d. 

Other,  or  multiple  rcspon.se 

0.0 

0.0 

0.0 

0.0 

0.0 

1.2 

0.0 

0.0 

1 2 

e. 

No  response 

0.0 

1.5 

0.0 

0.0 

0.0 

2 4 

0.0 

0.5 

2 4 

Have  you  had  any  problems  with  lost.  torn, 
or  dirty  T.O  pages? 
a.  Yes.  a lot 

20.8 

19.7 

20.9 

.36.1 

28.6 

28.1 

22.7 

20.0 

.37.8 

b. 

Some 

20.8 

33.3 

30.8 

25.0 

35.7 

37.8 

22.7 

33.2 

.317 

c. 

Verv  little 

37.5 

15.2 

26.4 

1 l.l 

14.3 

19.5 

31.8 

22.4 

12.2 

d. 

No 

20.8 

31.8 

22.0 

27.8 

21.4 

14.6 

22.7 

24  4 

18.3 

e. 

Other,  or  multiple  response 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

f. 

No  response 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

!X>  you  use  the  procedure  headings  as  a 
checklist? 


a. 

1 requcntly 

2(1.8 

16.7 

26  4 

33.3 

14,3 

37.8 

13.6 

25  9 

.34.2 

b. 

Sometimes 

58.3 

57.6 

49.5 

50.0 

57.1 

48.8 

63.6 

52.2 

48.8 

c. 

Never 

20.8 

24.2 

24.2 

13.9 

28.6 

1 1.0 

22.7 

21,5 

14  6 

d. 

Other,  or  multiple  respt>nse 

0.0 

0.0 

0.0 

2.8 

0.0 

0.0 

0.0 

0.0 

12 

e. 

No  rcs|x>n»e 

0.0 

1.5 

0.0 

0.0 

0.1. 

2.4 

0.0 

0.5 

1.2 

Woukl  you  prefer  to  use 
a.  Traditional-style  Kh 

4,2 

16.7 

20  9 

22.7 

28.6 

24  4 

13.6 

20.0 

22.0 

b. 

Job  (iuide-stylc  TOs 

58,3 

48.5 

59.3 

52.it 

42.9 

52.4 

40.9 

55  1 

5,3.7 

c. 

Checklists 

37.5 

18,2 

14.3 

19.4 

14.3 

14  6 

40  9 

16  1 

14  6 

d. 

No  TOs 

0.0 

12.1 

5.5 

2.8 

7.1 

.3.7 

4.6 

6 8 

.3.7 

e. 

Other,  or  multiple  rc-sponsc 

0.0 

3.0 

0.0 

2.8 

7.1 

4.9 

0.0 

15 

6 1 

f 

No  response 

0.0 

15 

0,0 

0.0 

0.0 

0.0 

0.0 

0.5 

0 0 

Slut 

a. 

IS  the  best  feature  of  the  Job  tiuides’’ 
.SiK 

29.2 

27.3 

29.7 

30,6 

21  4 

.30.5 

40.9 

27.8 

28  1 

b. 

Simplicity 

12.5 

19.7 

22  0 

25.0 

14,3 

1 1.0 

13,6 

20.0 

14.6 

c. 

Step-by-step  pnrcvdures 

41.7 

28.8 

25.3 

25.0 

28  6 

31  7 

27.3 

.30.2 

26  8 

d. 

lllustratioas 

0.0 

13.6 

4 4 

2.8 

7.1 

8.5 

4 6 

6.8 

8.5 

e. 

Oual-level  of  instructions 

4.2 

1-5 

0.0 

0,0 

0.0 

2.4 

0.0 

10 

2 4 

f. 

Other  or  multiple  respoase 

12.5 

9,1 

18.7 

16.7 

28  6 

14  6 

1.3.6 

13.7 

19  5 

8- 

No  response 

0.0 

0.0 

0.0 

0.0 

0.0 

1 2 

0.0 

0.5 

0.0 

Do  fold-out  pastes  make  the  illustrations? 
a.  Very  umvenient  to  use 

20.8 

30.3 

29.7 

1.3.9 

7 1 

20.7 

22.7 

25  9 

19,5 

b. 

No  problem  to  use 

54.2 

56  1 

48  4 

66.7 

85.7 

58.5 

54.6 

56.1 

59  8 

c. 

Difficult  to  use 

25.0 

12.1 

19,8 

16  7 

7 1 

19.5 

22.7 

15  6 

20.7 

d. 

Other,  or  multiple  respoase 

0.0 

1.5 

l.l 

2,8 

0.0 

0.0 

0.0 

1.5 

0.0 

e. 

No  response 

0.0 

0,0 

1.1 

0.0 

0(1 

1 2 

0.0 

1 () 

0.0 

TTie  illustrations  are 

a.  Necessary  to  complete  tik>st  jobs 

8.3 

9 1 

7.7 

5.6 

21  4 

8.5 

0.0 

9 3 

8.5 

b. 

Helpful  for  most  jobs 

75.0 

5 3.0 

57.1 

611 

57  1 

59.8 

72.7 

57.1 

61.0 

c. 

JJelplul  but  usually  not  nece.ssary 

16.7 

34.9 

34.1 

3.3.3 

214 

31.7 

27. .3 

32.2 

.30.5 

d. 

Not  needed  for  any  job 

0.0 

1.5 

0 0 

0.0 

0.0 

0(1 

0.0 

0.5 

0.0 

e. 

Other,  or  multiple  respimse 

0.0 

15 

1 1 

0.0 

0.0 

0.0 

0.0 

1.0 

0.0 

f. 

No  response 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0 0 

0.0 

0.0 

I able  2 {Continued) 


Gride  Skill  Level 


Qu*ttloni 

2 

3 

4 

5 

64i7iii 

lO&lt 

3 

s 

7A* 

)(>. 

11k*  index  IS 
j.  Very  hdpliil 

.<iK  ^ 

47.0 

47.3 

417 

57,1 

46  .3 

3 i .8 

49.3 

46  3 

h.  L-suall>  hciptui 

37. .S 

515 

51.7 

52.8 

42.9 

45  1 

63.6 

47.3 

48  8 

» - Oihor.  nr  multiplo  res|x*nsc 

0.0 

1.5 

11 

2.8 

0.0 

6.1 

O.O 

2.4 

3.7 

d.  No  response 

■1.2 

0.0 

0.0 

2.8 

0.0 

2.4 

4,6 

1.0 

1.2 

17. 

Hovk  usx'tul  IS  the  (i.AM'* 
j.  Ver>  useful  I'sed  (rctjuently 

4.2 

7.0 

6 6 

5.6 

28  6 

1 1.0 

0.0 

6 8 

15.9 

b.  S<»mowhat  useful  Used  iKuisionally 

41.7 

27.3 

28.6 

50.0 

14.3 

36.6 

31.8 

32.7 

34.2 

L.  Seldom  useful.  Karely  us^'d 

U..7 

15.2 

17,6 

5.6 

28.6 

12,2 

18.2 

15  1 

12  2 

d.  Have  nevs’^  usesi  it 

37.S 

47.0 

44  (1 

38.9 

28.6 

14.2 

50.0 

42.0 

34.2 

e.  Other.  Multiple  response 

0.0 

0.0 

0.0 

0,0 

0.0 

1.2 

0.0 

0.5 

( .0 

f . No  respoi  s*.' 

0() 

3.0 

3.3 

0.0 

0.0 

4,8 

0.0 

2.9 

3.7 

IK. 

•\s  a source  of  iii.ormation  tor  your  j(d).  the 
new  Job  >!ijjde  m inuals  ;*re 
a.  Much  better  than  the  old  KK 

25.0 

12  1 

13.2 

11.1 

214 

12.2 

18.2 

14.2 

12.2 

b.  lietter  than  the  old  KK.  but  can  l>e 

refined 

70.K 

5.3.0 

58.2 

52  8 

50.0 

5 2.4 

72.7 

54.2 

54.9 

c.  No  better  than  the  old  lOs 

4.2 

27.3 

17.6 

16.7 

28.6 

15.9 

9.1 

20.0 

17  1 

d.  Worse  than  the  old  T(K 

0.0 

6.1 

8.8 

19  4 

0.0 

19.5 

0.0 

10,2 

15  9 

e.  Other,  or  multiple  response 

0.0 

0.0 

1.1 

0.0 

0.0 

0.0 

0.0 

0.5 

0.0 

!.  No  resj>«)nse 

0.0 

1.5 

11 

0.0 

0.0 

0.0 

0.0 

1.0 

0.0 

I<). 

Do  you  feel  that 

a.  You  use  J(iMs  imire  than  the  lOs'’ 

54.2 

11.8- 

37.4 

22.2 

21.4 

.37,8 

59.1 

35  6 

26.8 

b.  About  the  same  as  the  old  lOs*^ 

37.5 

51  5 

42.9 

55.6 

78.6 

46.3 

31.8 

47,8 

54.9 

c,  la-’ss  than  the  old  T(K'^ 

4.2 

15.2 

17.6 

22.2 

0.0 

15  9 

4 6 

15  1 

18  3 

d.  Other,  or  multiple  res|H»nse 

0.0 

0.0 

11 

0.0 

0.0 

0.0 

0.0 

0.5 

0 0 

c.  Nr)  fesponw* 

4.2 

1.5 

1.1 

0,0 

0.0 

0.0 

4.6 

1.0 

0.0 

211. 

How  valuable  do  you  think  the  Job  (luides 
arc  to  ()J  I ' 

a.  Valuable  much  better  than  the  old 

ros 

45.  K 

45.5 

5/.1 

50.0 

50.0 

46.3 

45.5 

50.7 

48.8 

b.  Valuable  al>out  the  same  as  the  old 

lOs 

.3.3.3 

33.3 

28  6 

19  4 

.35.7 

.34,2 

31.8 

31.7 

28.1 

c.  OI  little  value  abr>ut  the  same  as  the 

old  KK 

20.K 

10.6 

9 9 

19  4 

14  3 

13.4 

18.2 

11.2 

15  9 

d ()t  no  value  much  worse  than  the 

old  lOs 

0.0 

9.1 

3.3 

8.3 

O.lt 

4.9 

4.6 

4 9 

6 1 

e.  Other,  or  multiple  resjH)rise 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.5 

0.0 

1,  No  responsi* 

0.0 

1.5 

1.1 

2.8 

0.0 

1.2 

0.0 

1.0 

1 2 

21 

As  an  ()J T trainer.  Job  Ouides  arc. 
a.  Very  valuable  much  better  th  in  the 

old  lOs 

37.5 

39.4 

47.3 

47.2 

50.0 

39.0 

40.9 

42.9 

4 3.9 

h.  Valuable  about  the  same  as  the  old 

KK 

20.8 

27.3 

33.0 

27.8 

42  9 

42.7 

18.2 

32.7 

37.8 

c.  Of  liftle  value  afx»uf  the  same  as  the 

old  TOs 

12.5 

15,2 

10.0 

1 .3.9 

7.1 

II.O 

9.1 

12.2 

1 1,0 

d.  Of  no  value  much  wone  than  the 

old  TOs 

0.0 

6.1 

4 4 

8.3 

0(1 

4,9 

0.0 

4.9 

6.1 

e.  Other,  or  multiple  res|>onsc 

0.0 

0.0 

0.0 

2.8 

0.0 

0.0 

0.0 

0.5 

0.0 

!.  No  res^xiiiv 

29.2 

12.1 

5.5 

0.0 

0.0 

2.4 

31.8 

6.8 

12 

22 

Does  use  of  Job  Ciuides  allow  less 
cxperRmced  ter  hnicians  to  do  more  jobs'* 
a.  Yes 

54.2 

50.0 

48.4 

.36  1 

.35.7 

37  8 

50.0 

49.8 

31.7 

b.  No 

25.0 

47.0 

46.2 

63.9 

64.3 

54.9 

.36.4 

44  9 

63.4 

c.  Other,  or  multiple  nrsponsc 

0.0 

1.5 

2.2 

0.0 

0.0 

1.2 

0.0 

1.5 

1.2 

d.  No  responM* 

20.K 

1.5 

3.3 

0.0 

0.0 

6,1 

1.3.6 

3.9 

3.7 

Table  2 iCotiiinucil) 


Grade 


Skill  Level 


Quettlont 

2 

3 

4 

s 

647«i8 

laiin 

3 

s 

7(,9 

:3. 

Would  you  recommend  that  J(»Ms  be 
purchased  tor  use  in  your  sliop'’ 

X Yev  tor  at)  tasks 

37.5 

27.3 

14.1 

33  3 

4?  ‘1 

34.2 

3b. 4 

32.7 

32.9 

b.  '^cs.  tor  some 

54.2 

62.1 

52.8 

47.2 

5IMt 

4 3 9 

S4  b 

52.2 

512 

u No 

4.2 

9.1 

1 1 0 

19  4 

7,1 

19  5 

4 .b 

1 3.7 

1 3 4 

d.  Other,  or  multiple  response 

(Ml 

0.0 

0.0 

0.0 

0.0 

0.0 

0 () 

0.0 

0.0 

e.  No  resjx)nsc 

4.2 

1.5 

2.2 

(Ml 

0.0 

2.4 

4.5 

1.5 

2 4 

24. 

Would  you  rcu)Tnmend  that  l l’l  As  l>e 
purchased  lor  use  in  your  shop'’ 

X Yes.  tor  all  tasks 

45  H 

27  3 

23.1 

3 3.3 

b4  1 

23.2 

45.5 

26.3 

30.5 

b.  Yes.  for  some  tasks 

45. K 

56  1 

59.3 

41.7 

2K.6 

57.3 

45.5 

56.6 

48.8 

u No 

8.3 

1 3.6 

12.1 

25.0 

7 ! 

14.6 

y.I 

1 3.7 

15  9 

d.  Other,  or  multiple  response 

(Ml 

1.5 

0.0 

(Ml 

0.0 

0.0 

0.0 

0.5 

0.0 

e.  No  resptTnsc 

().(l 

1.5 

5.5 

0.0 

0.0 

4.9 

Of) 

2.9 

4 9 

25. 

'Hie  new  5i(iMs  and  1 Tt  As  help  you  do  your 
job'’ 

a.  IWttci 

75  (I 

42  4 

48.4 

41.7 

2Kb 

4 3.9 

b3.b 

47  3 

40.2 

b.  About  the  same 

25.(1 

54  6 

46.2 

47.2 

71  4 

45.1 

31. K 

46.8 

51  2 

c.  Not  as  well 

(1.(1 

3.(1 

3.3 

1 1.1 

0.0 

7.3 

4 ,b 

4 J 

6.1 

d.  Other,  or  multiple  resptmse 

(Ml 

(1.0 

0.0 

0.0 

0.0 

0.0 

0.0 

().(. 

O.O 

e.  No  a’sptmse 

(Ml 

0.0 

2.2 

0.0 

0 () 

3.7 

0.0 

1.5 

2.4 

26 

Do  yt)U  like  having:  detailed  step-l>y*step 
instructions  such  as  those  found  in  the 
JC.Ms'’ 
a.  Yes 

79.2 

68  2 

60.4 

6 3.9 

7K.b 

6 3.4 

72.7 

65  4 

64.6 

b.  Makes  no  dttference 

2(1.8 

31.8 

31.9 

22.2 

21.4 

23.2 

27.3 

27.8 

24  4 

c.  No 

(Ml 

(Ml 

5.5 

1 3.9 

0.0 

7.3 

0.0 

5 4 

6 1 

d.  Other,  or  multiple  response 

(1.(1 

(Ml 

0.0 

0.0 

0.0 

2 4 

0.0 

(1.5 

1.2 

c.  No  resptmse 

(1.(1 

0.0 

2.2 

0.0 

0.0 

3.7 

0.0 

1.0 

.3.7 

27. 

Do  you  like  liavm^  detailed  illustrations 
keyed  to  the  step-by-»tep  pn)cx‘dui\*s'’ 
a.  Yes 

79.2 

77.3 

58.2 

69  4 

71  4 

75  6 

77.3 

69  3 

70.7 

b.  M.ikcs  no  diflerencc 

2(1.8 

21  2 

.36.3 

25.0 

2K  (» 

15.9 

IK  2 

26  8 

22  (1 

c.  No 

(l.d 

1.5 

3.3 

5.6 

0.0 

3.7 

4.b 

2 9 

2 4 

d.  Other,  or  multiple  response 

(1.(1 

0.0 

(Ml 

0.0 

0.0 

1 2 

0.0 

0.0 

1.2 

c.  No  response 

(1.0 

0.0 

2.2 

0.0 

0.0 

3.7 

0,0 

1 0 

3.7 

2K. 

Which  type  of  technical  data  woukl  you 
pretei  to  use?  l or  routine  jobs 
a.  Iraditionat  lO 

4.2 

10.6 

12  1 

22.2 

7.1 

15.9 

I3.b 

12  7 

13  4 

b.  (hecklist 

37.5 

39.4 

29.7 

36  1 

SO.O 

26.8 

45  5 

31  2 

34.2 

c.  Job  (iuide  Manuals 

45.8 

37.9 

418 

25.0 

35.7 

34.2 

27.3 

40.5 

317 

d.  Very  jicncra.'  procedures 

12.5 

9 1 

12.1 

13.9 

7.1 

9.8 

13.b 

11.2 

9.8 

c.  Other,  or  muliipic  response 

(Ml 

3.0 

2.2 

2.8 

0.0 

9.8 

0.0 

.3.4 

7.3 

f.  No  response 

0.(1 

0.0 

2.2 

(!.(' 

0.0 

3.7 

0.0 

1 0 

3.7 

29. 

l or  non'routine  jobs 
a.  Traditional  10 

8.3 

22.7 

19.8 

27.8 

2K.() 

25.6 

22.7 

22.0 

23.2 

b.  ('hecklist 

8.3 

4.6 

13.2 

8.3 

0.0 

13.4 

9.1 

10.7 

8 5 

r Job  (luide  Manual 

79.2 

62.1 

57.1 

61.1 

57  1 

48.8 

bK.2 

56  6 

58  5 

d.  Very  general  instruciions 

(1.0 

7.6 

7.7 

2.8 

14  .1 

3.7 

0.0 

7.3 

3.7 

e.  (Khcr.  or  multiple  response 

4.2 

1.5 

1 .1 

O.O 

0.0 

4.<? 

0.0 

2 4 

2 4 

f.  No  response 

0.0 

1.5 

1.1 

0.0 

0.0 

3.7 

0.0 

1.0 

.3.7 

40 


Tabic  2 {(ontinuvJ) 


Grad* 

Skill  Level 

Questions 

2 

3 

4 

5 

68.78.8 

108.11 

3 

5 

78.9 

.lb.  I)l> 

1 I'l  \s  require  more  or  less  time  to 

troublesh<H>t  a problem*’ 

3 les'  time  is  reouired  usim’  l I TAs. 

20.11 

16  7 

33.3 

36. « 

1 II 

23  1 

20.0 

26  9 

27.5 

K. 

About  the  same  amount  ol  lime 

4(M) 

50.0 

37.H 

21.1 

44.4 

4h.7 

60.0 

4 i ,9 

35  0 

c. 

More  time  is  a'quired  when  using 
1 IT  As 

40.(1 

33.3 

26.7 

.36. H 

44  4 

25.6 

20.0 

29.0 

.35  0 

d. 

Other,  or  multiple  resjH>nse 

0.0 

0.0 

2 2 

5..^ 

0.0 

2.6 

n.o 

2.2 

2.5 

Total  Number  ol  Respondents  Per  Cak'pory  “ 

10 

24 

45 

1*7 

q 

39 

10 

93 

40 

Table  .1  Percentage  of  Subject  Respoases,  by  AFSC,  to  Fach  Question 
of  the  Job  Guide  Questionnaire 


AFSC 

Questlont  325X0  325X1  328X0  328X1  328X4  423X6  423X1  423X3  431X1  426X2 


1.  Mow  do  you  like  Ihc  Job  (iuidc 
V inuals*^ 

a.  (\>niplck*|y  .sativ^'acior) 

b.  (iood.  but  couid  be  improved 

c.  SatLsfacIi  ry.  but  no  better 
than  the  old  TOs 

d.  I'nsatistaiiory 

c.  Other,  ot  's.ultiple  response 

f.  No  response 

2.  Hie  sire  of  the  Job  Ciuide  Manual  b 

a.  loo  small 

b.  ItH)  biy 
Okay 

d.  Just  ri^)t 

c.  Other.  <u  multiple  res|H)nM* 

I.  No  rcsj>s>nsi* 

.V  The  illustrations  are 
X I xcellenl 

b.  Poor 

c.  Okay 

d.  Other,  or  multiple  response 

e.  No  response 

4.  Do  Ihc  job  ^uide  prt'tvdurrs 
contain  all  the  inf(*<'niation  y'^ru 
need  to  do  the  job'’ 

a.  Yes,  for  all  jobs 

b.  Yes,  for  most  jobs 

c.  Some  information  is  missiny. 
but  guides  arc  still  useful 

d.  Missing  information  nukes 
job  guides  unusable 

e.  Other,  or  multiple  response 

f.  Nt)  rrsptmsc 

5.  Are  the  procedures  aureef’ 

a.  Alrrv'st  always 

b.  Mostly 

c.  Seldom 

d.  Never 

e.  Other,  or  multiple  resptmse 

f.  No  resp<mse 


0.0 

0.0 

10.5 

IK. 2 

(VO 

91.7 

77.8 

52  6 

77.3 

57  1 

HJ 

0.0 

31.6 

4 .6 

35.7 

0.0 

22.2 

5.3 

0.0 

7.1 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

on 

0.0 

0.0 

K.3 

16.7 

5.3 

4,6 

0.0 

0.0 

0.0 

0.0 

9.1 

7.1 

66.7 

44  4 

K4.2 

54.6 

71.4 

25.0 

3K.9 

10.5 

3I.K 

21.4 

0.0 

0.0 

(1,0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

33.3 

27. K 

10.5 

27,3 

35.7 

0.0 

22.2 

5.3 

4 6 

7.1 

66.7 

.50.0 

K4.2 

6K.2 

57.1 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0 (I 

0.0 

0.0 

3.0 

5.6 

10.5 

0.0 

7.1 

16.7 

1 l.l 

36.8 

59.1 

28.6 

5K.3 

66.7 

36  8 

40.9 

64.3 

25.0 

16.7 

15.8 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

•'ll 

0.0 

8.3 

22.2 

52  6 

45  5 

35.7 

75.0 

72.2 

42.1 

54.6 

64.3 

16.7 

5 6 

5.3 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0 (1 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

4.2 

16.7 

12.1 

15  4 

70.6 

79.2 

83  3 

61.7 

84  6 

17.7 

8.3 

0,0 

18.4 

0.0 

1 1.8 

8.3 

0.0 

S.l 

0.0 

O.o 

0.0 

(Ml 

0.7 

0.0 

0.0 

0 0 

0.0 

1.4 

0.0 

1 1.8 

4.2 

8.3 

14  2 

7.7 

0.0 

0.0 

8.3 

1.4 

0.0 

70.6 

62.5 

41.7 

56.0 

50  1) 

17.7 

33.3 

417 

28,4 

42.3 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

29.4 

16.7 

417 

19.2 

26  9 

23.5 

25,0 

8.3 

16  3 

115 

47.1 

58.3 

50,0 

63.8 

61.5 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.7 

0.0 

0.0 

0.0 

0.0 

5.0 

11.5 

17.7 

45.8 

41.7 

31.2 

50.0 

76.5 

37.5 

50.0 

5 3.9 

38  5 

5.9 

16.7 

8 3 

9.2 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.7 

0.0 

35.3 

25,0 

50.0 

34.8 

.30.8 

58.8 

70.8 

50.0 

60.3 

69.2 

5.9 

4,2 

0,0 

4,3 

0.0 

0.0 

0.0 

0.0 

0 0 

0.0 

0.0 

0.0 

0 0 

0.7 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

42 


Tabic  .1  (Continui'd) 


AFSC 

- 

QuettloiH 

325X0  325X1  321X0  325X1  32tX4  423XC  423)^1  423X3  431X1  42«X2 

Dll  you  have  any  iliUkully  in 
undeiMamlini:  the  proecdures? 

.1  \lwav^ 

0 II 

5.6 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.7 

0.0 

t*. 

NK)st!y 

K..1 

5.6 

5.3 

0.0 

0.0 

5.9 

4 2 

0.0 

14 

0.0 

u 

(Xiasionally 

41.7 

61.1 

26.3 

45.5 

57.1 

58.8 

66.7 

50.0 

70.9 

53.9 

il. 

Never 

5IU) 

27.8 

68.4 

54  6 

42.9 

35.3 

25.0 

50.0 

26.2 

46  2 

c 

Other,  or  multiple  rcsjxinse 

().() 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.7 

0 0 

i. 

No  respimse 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

4.2 

0.0 

0.0 

0.0 

7. 

Arc 

one 

3. 

too  many  biMiks  required  to  do 
job? 

Always 

H..1 

5.6 

5.3 

0.0 

0.0 

17.7 

0.0 

0.0 

5.7 

0.0 

b. 

Mostly 

K.J 

11. 1 

0.0 

‘'.I 

0.0 

17.7 

8.3 

8.3 

10  6 

0.0 

c. 

(Kcask>nall> 

75.0 

55.6 

52.6 

31.8 

35.7 

47.1 

45.8 

25  0 

58  9 

50.0 

d. 

Never 

K..1 

27.8 

42.1 

59.1 

64.3 

17.7 

45.8 

66.7 

24.8 

50.0 

e. 

Other,  or  multiple  response 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

1. 

Nt>  resp^mse 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

H. 

IX)  you  llnd  the  procedures  in  the 
Job  guides  to  Ih*  t(M)  simple  (too 
detailed)? 

a.  Yes,  lor  most  jobs 

25.0 

0.0 

42.1 

18.2 

21.4 

17.7 

20.8 

0.0 

12.1 

7.7 

b 

Yes,  for  some  jobs 

33.3 

27.8 

31.6 

18.2 

42.9 

29.4 

12.5 

41.7 

36.9 

19,2 

u 

No,  about  right  for  most  jobs 

41.7 

66.7 

26.3 

63.7 

35.7 

47.1 

66.7 

58.3 

50.4 

73.1 

d. 

OlhCT.  or  multiple  resjx>nse 

0.0 

5.6 

0.0 

0.0 

0.0 

5.9 

0.0 

0.0 

0.0 

0.0 

c. 

No  response 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

O.ll 

0.7 

0.0 

4. 

Do 

a. 

you  use  the  dual-level  feature? 
Most  ly 

8.3 

0.0 

0.0 

22.7 

7.1 

1 1.8 

0.0 

8.3 

12.8 

7.7 

b. 

Seldom 

0.0 

5.6 

15.8 

31.8 

28.6 

23.5 

12.5 

0.0 

14.9 

11.5 

c. 

What  IS  the  dual-level  feature? 

91.7 

88.9 

84.2 

45.5 

57.1 

64.7 

87.5 

91.7 

70.9 

80.8 

d. 

Other,  or  multiple  response 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.7 

0.0 

e. 

No  resjx)nse 

0.0 

5.6 

0.0 

0.0 

7 1 

0.0 

0.0 

0.0 

0.7 

0.0' 

10. 

Haw  you  had  any  problems  with 
lost.  torn,  or  dirty  I.O.  pages*' 
a.  Yes.  a lot 

33  3 

22.2 

21.1 

22.7 

14.3 

47.1 

4.2 

8.3 

31.2 

11.5 

b. 

St*  me 

33.3 

22.2 

15.8 

9.1 

50.0 

23.5 

37.5 

25.0 

37.6 

.38.5 

c. 

Very  little 

8.3 

27.8 

31.6 

36.4 

21.4 

17.1 

25.0 

8.3 

12.1 

.34.6 

d. 

Nti 

25.0 

27.8 

31.6 

31.8 

14.3 

11.8 

33.3 

58.3 

19.2 

15  4 

e. 

Other,  or  multiple  response 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

.0.0 

0.0 

i. 

Nt*  resptmse 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

II. 

O) 
as  a 
a. 

you  use  the  procedure  headings 
checklist'' 

1 ruquently 

0.0 

5.6 

10.5 

4.6 

21.4 

52.9 

29.2 

25.0 

33.3 

46  2 

b. 

Sometimes 

75.0 

72.2 

47.4 

72.7 

50.0 

35.3 

58.3 

66.7 

46  1 

.38.5 

c. 

Never 

25.0 

II. 1 

42.1 

22.7 

28.6 

11.8 

12.5 

8.3 

19.9 

15  4 

d. 

Other,  or  multiple  response 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.7 

0.0 

e. 

No  response 

0.0 

1 l.l 

0.0 

0.0 

b.o 

0.0 

0.0 

0.0 

0.0 

0.0 

12. 

Would  you  prefer  to  use 
a.  Traditional-style  TOs 

16.7 

22.2 

21.1 

13.6 

7.1 

41.2 

29.2 

16  7 

18  4 

15.4 

b. 

Job  Guidc-iilyle  TOs 

41.7 

50.0 

26.3 

63.6 

35.7 

47.1 

54.2 

83.3 

52.5 

80.8 

c. 

Check  hsl< 

16.7 

II. 1 

31.6 

18.2 

57.1 

5.9 

8.3 

0 0 

20.6 

0 0 

d. 

No  TOs 

16.7 

5.6 

15.8 

0.0 

0.0 

0.0 

8.3 

0.0 

6.4 

3 9 

e. 

Other,  or  multiple  response 

8.3 

5.6 

5.3 

4.6 

0.0 

5 9 

0.0 

0.0 

2.1 

0.0 

f. 

No  response 

0.0 

5.6 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

43 


Tabic  3 (Continued) 


AFSC 

Quotloni  32SX0  12SX1  32tX0  321X1  321X4  423X6  423X1  423X3  431X1  426X2 


13 


14. 


15. 


16. 


17. 


IS. 


19. 


What  IS  the  best  feature  of  the  Job 
(i  aides'* 


a. 

Sue 

5I).() 

III 

26.3 

27.3 

28.6 

5.9 

37.5 

8 3 

34  8 

15  4 

b. 

Simplkity 

16  7 

3.3.3 

36.8 

31.8 

28.6 

17.7 

16.7 

25.0 

9.2 

23  1 

c. 

Stei>-hy-slcp  pn>c«lures 

16.7 

27.8 

21.1 

18.2 

28.6 

58.8 

33.3 

33.3 

28,4 

10  8 

d. 

Illustrations 

K 3 

5.6 

10.5 

4 6 

7.1 

0.0 

4.2 

8.3 

8.5 

3.9 

c. 

Dual-level  of  instructions 

0.0 

0.0 

0.0 

O.O 

0.0 

5.9 

0.0 

0.0 

2 1 

0.0 

f. 

Other  or  multiple  response 

K.3 

22.2 

5.3 

18.2 

7.1 

1 1.8 

4.2 

25.0 

17.0 

26  9 

Ntv  response 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

4,2 

0.0 

0.0 

0,0 

Do  fold-out  pages  make  the 
ilIustTation.s'* 

a.  Very  convenient  to  use 

41.7 

33.3 

5.3 

13.6 

14.3 

2.3.5 

37.5 

33.3 

25.5 

15  4 

b. 

No  problem  to  use 

33.3 

55.6 

73.7 

72.7 

64.3 

70.6 

45.8 

66.7 

50.4 

73  1 

c. 

IhlTuult  to  use 

25.0 

5.6 

21.1 

13.6 

21.4 

5.9 

12.5 

0.0 

22.0 

II. 5 

d. 

c)thcf.  or  multiple  response 

0.0 

5.6 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

1.4 

O.O 

c. 

No  responsi’ 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

4.2 

0.0 

0.7 

0.0 

Ihe  illustrations  are 
a.  Necessary  tc3  complete  most 

>obs 

0.0 

5.6 

5.3 

9.1 

21  4 

29,4 

4.2 

8.3 

8.5 

0.0 

b. 

Helpful  tor  most  jobs 

16.7 

50.0 

10.5 

31.8 

.35.7 

52.9 

70.8 

83.3 

69.5 

84,6 

c. 

Helpful  but  usually  not 
necessary 

«3.3 

44.4 

84.2 

59.1 

42.9 

17.7 

25.0 

8.3 

20.6 

11.5 

d. 

Not  needed  for  any  job 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0 0 

0.7 

0.0 

c. 

Other,  or  multiple  respome 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.7 

3.9 

1. 

No  rcsp^lnse 

0 0 

O.P 

0.0 

0.0 

0.0 

0,0 

0.0 

0.0 

0.0 

0.0 

Ihe  index  is 
a.  Very  helpful 

41.7 

33.3 

42.1 

27.3 

21.4 

5 2.9 

45.8 

58  3 

50.4 

73.1 

b. 

Usually  helpful 

58.3 

66.7 

57.9 

68.2 

78.6 

47.1 

45  8 

41.7 

44.7 

19.2 

c. 

Other,  or  multiple  response 

0.() 

0.0 

0.0 

4 6 

0.0 

0.0 

8.3 

0.0 

3,6 

0.0 

d. 

N<»  response 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

1.4 

7.7 

How 

a. 

useful  IS  the  liAM** 

Very  useful  Used  frequently 

8.3 

5.6 

0.0 

9.1 

7 1 

1 1.8 

4.2 

25.(1 

9.2 

7.7 

b. 

Somewhat  useful  Used 
0(xa9onaliy 

41.7 

16.7 

10.5 

40.9 

35.7 

41.2 

33.3 

50.0 

34.8 

23.1 

i 

Seldom  useful.  Karely  u.scd 

25.0 

27.8 

21.1 

9 1 

14  3 

17  7 

20.8 

0.0 

13.5 

7 7 

d. 

Have  never  used  it 

25.0 

50.0 

68.4 

318 

42  9 

29.4 

41  7 

25.0 

37.6 

57.7 

c. 

Other,  or  multiple  respoase 

0.0 

0.0 

0.0 

4.6 

0.(1 

0.0 

0.0 

0.0 

0 II 

0 (I 

t. 

No  response 

0.0 

0.0 

0.0 

4.6 

0.0 

0.0 

0.0 

0.0 

5,0 

3.9 

An  a v»ufU‘of  informatHin  for  your 
job.  the  new  job  guide  manuals  are 
a Much  b<*ller  than  the  okl  I(K 

0.0 

5.6 

10.5 

18.2 

0.0 

1 1 8 

4.2 

16.7 

15.6 

26  9 

b. 

Better  than  the  old  lOs,  but 
can  be  refined 

66.7 

44.4 

52.6 

68.2 

64  3 

58.8 

70.8 

66.7 

511 

57.7 

c. 

No  better  than  the  okl  Ills 

8 3 

33.3 

15.8 

13.6 

14.3 

1 1.8 

12.5 

0.0 

23.4 

11.5 

d. 

Worse  than  the  old  lOs 

25.0 

16.7 

211 

0.0 

21.4 

17.7 

8.3 

8.3 

9.2 

3.9 

c. 

Other,  or  multiple  respoase 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

4.2 

0.0 

0.0 

0.0 

f. 

Nt»  res()onse 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

8 .3 

0.7 

0.0 

I><)  you  feel  that 

a.  You  u*  )(iMs  more  than  the 

ro4? 

41.7 

1 1.1 

15  8 

31.8 

14.3 

35.3 

41.7 

66.7 

36.2 

53  9 

b 

Ah<iul  tire  unic  as  the  old 
roi? 

41.7 

72.2 

63.2 

68.2 

50.0 

41.2 

45.8 

25.0 

44.0 

46.2 

c. 

Iar«  than  the  iild  Kh? 

16.7 

16.7 

21.1 

0.0 

28.6 

23.5 

8.3 

0.0 

19.2 

0.0 

d. 

Other,  oi  multiple  tcsp<miie 

0.0 

0.0 

0.0 

0.0 

7.1 

0.0 

0.0 

0.0 

0.0 

0,0 

e. 

No  teaponve 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

4.2 

8.3 

0.7 

0.0 
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Tabic  3 (Continued) 


AFSC 


Qu«fttont 

325X0 

325X1 

325X0 

321X1 

32SX4 

423X6 

423X1 

423X3 

431X1 

426X2 

How  valuable  do  you  think  the  Job 
(iuidev  an.*  to  OJ  T’ 
a.  Valuable  much  better  than 

the  old  KK 

50.0 

61.1 

52.6 

86.4 

50.0 

47.1 

17  5 

66.7 

44.0 

50.0 

b.  Valuable  about  the  same  as 

the  old  T(K 

16.7 

21  1 

1.1.6 

35.7 

29.4 

37.5 

25. ( 

32.6 

.18,5 

e.  ()1  little  value  about  the 

same  as  the  old  Ttb 

S..1 

16.7 

26.3 

0.0 

0.0 

1 1.8 

20.8 

0.0 

15.( 

7.7 

d.  Of  no  value  much  worse 

than  the  old  K)s 

8.1 

5.6 

0.0 

0.0 

14.3 

1 1.8 

4.2 

0.0 

5.7 

19 

e.  Other,  or  multiple  response 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.7 

0.0 

f.  No  resf>onse 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.( 

8,3 

l.< 

0.0 

As  an  OJl  trainer.  Job  (luidcs  are 
a.  Very  valuable  much  better 

41.7 

44.4 

52.6 

77.'' 

12.9 

than  the  old  TOs 

47.1 

29.2 

66.7 

35.5 

46  2 

b.  Valuable  about  the  same  as 

the  old  TOs 

.13.3 

27.8 

15.8 

18.2 

28.6 

35.3 

37.5 

25.0 

37.6 

.18.5 

c Of  little  value  about  the 

same  as  the  old  IX)s 

8.1 

27.8 

26.3 

4 6 

0.0 

1 1.8 

8.3 

0.0 

12.1 

7.7 

d.  Of  no  value  - mudi  worse 

than  the  old  TOs 

8.3 

0.0 

0.0 

0.0 

14.3 

5.9 

8.3 

0.0 

5 0 

7.7 

e.  Other,  or  multiple  response 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.7 

0.0 

t.  No  n:sjx>nse 

8.3 

0.0 

5.3 

0.0 

14.3 

0.0 

16.7 

8.3 

9.2 

0.0 

Does  use  of  Job  (iuides  allow  less 
extK’rienccd  teihnicians  to  do  more 
jobs? 
a.  Yes 

3.1.1 

27.8 

42.1 

59.1 

50.0 

47.1 

.17.5 

58,3 

44.0 

57.7 

b.  No 

86.7 

66.7 

57.9 

40.9 

42.9 

52.9 

50.0 

25.0 

48.2 

42.3 

c.  Other,  or  multiple  response 

0.0 

0.0 

0.0 

0.0 

7.1 

0.0 

0.0 

0.0 

2.1 

0.0 

d.  So  response 

0.0 

5.6 

0.0 

0.0 

0.0 

0.0 

12.5 

16.7 

5.7 

0 0 

Wv>uld  you  recxwnmend  that  J(iMs 
be  purchawd  for  use  m your  shop? 
a.  Yes.  for  all  tasks 

16.7 

38.9 

10.5 

54,6 

15.7 

23.5 

25.0 

25.0 

30.5 

61.5 

b.  Yes,  for  some  tasks 

66.7 

50.0 

68.4 

45.5 

35.7 

64.7 

62.5 

58.3 

51.8 

.14.6 

c.  No 

16.7 

11.1 

21.1 

0.0 

28.6 

1 1.8 

12.5 

8.3 

14.2 

3.9 

d.  Other,  or  multiple  response 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

e.  No  response 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

8.1 

3.6 

0.0 

Would  you  recommend  that  l.T  l As 
be  purchased  for  use  in  your  sh«>p? 
a.  Yes.  for  all  tasks 

41.7 

38.9 

10.5 

31.8 

50.0 

17.7 

33.3 

8.3 

25.5 

42.3 

b.  Yes.  for  some  tasks 

41.7 

50.0 

47.4 

68.2 

214 

70.6 

45.8 

66.7 

57.5 

50  0 

u No 

16.7 

11.1 

42.1 

0.0 

28.6 

11.8 

12.5 

8.3 

12.8 

3.9 

d f)ther.  or  multiple  responst 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.7 

0.0 

c.  No  resptinse 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

8.3 

16.7 

3.6 

3.9 

I he  new  JO  Ms  uAd  L I lAs  help 
you  do  your  job? 
a.  Better 

50.0 

50.0 

21.1 

68.2 

57  1 

41.2 

33.3 

58.3 

41.8 

69.2 

b.  About  the  same 

33.3 

44.4 

68.4 

31.8 

28.6 

47.1 

58.3 

33.3 

53.2 

.10.8 

c.  Not  as  well 

16.7 

5.6 

10.5 

0.0 

14.3 

11.8 

4.2 

0.0 

2.8 

0.0 

d.  Other,  or  multiple  response 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

e.  No  respfinse 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

4.2 

8.3 

2.1 

0.0 

Do  you  like  having  detailed 
stcpby-siep  instrudions  such  as 
those  found  in  the  JOMs? 
a.  Yes 

50.0 

66.7 

42.1 

68.2 

50.0 

76.5 

62.5 

75.0 

65.3 

88  5 

b.  Makes  no  difference 

33. .1 

33.3 

36.8 

9.1 

42.9 

23.5 

37.5 

16.7 

27.7 

11.5 

c,  Nt) 

16.7 

0.0 

21.1 

18.2 

7.1 

00 

0.0 

0.0 

3.6 

0.0 

d.  Other,  or  multiple  response 

0.0 

0.0 

0.0 

4.6 

0.0 

0.0 

0.0 

0.0 

0.7 

0.0 

e.  No  response 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

8.3 

2.8 

0.0 
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Table  3 (Continued) 


AFSC 

Qu«ttH>nt  32&X0  325X1  32SXO  32tX1  32SX4  423X6  423X1  423X3  431X1  426X2 


27.  Do  you  like  having  detailed 
illustrations  keyed  to  the 
step-by-step  procedures'* 

a.  \es 

h.  Makes  no  dilTerence 

c.  N»i 

d.  Other,  or  multiple  response 

e.  No  respsmiic 

2K.  Wliich  type  of  technical  data  would 
you  prefer  to  use”*  l or  routine  jobs 

a.  Traditional  TO 

b.  rhecklisl 

c.  Job  (iuide  Manuals 

d.  Very  general  proet^durcs 

c.  Other,  or  multiple  response 

f.  No  resptm.^e 

29.  I or  non-routine  jobs 

a.  Iraditiona}  ro 

b.  ('heciilist 

c.  Job  (ruide  Manual 

d.  Very  general  Instructions 

e.  fTfher.  or  mutuph:  res|x>n.w 

f.  No  response 

JO.  How  do  you  feel  about  being 

required  to  use  KlM.s  for  every  job? 

a.  Pleased 

b.  Mostly  pleased 

c.  Somewhat  irritated 

d.  Irritated 

e.  Other,  or  multiple  response 

f.  No  restxmsc 

31.  ^^''hich  would  be  the  most  helpful  to 

you  in  transferring  to  a new 

aircraft? 

a.  A T('  5thtH)l 

b.  I TD  school 

c.  OJT 

d.  J(;Ms  and  UTA-s 

e.  Conventi<*nal  70 

I Other,  or  multiple  respoase 

g.  No  respimse 

32.  Which  do  you  believe  would  most 
improve  the  efficiency  of 
maintenance  oi>erations'’ 

a.  More  AK'  training 

b.  Hetter  AXr  training 

c.  Better  ainventH^nal  lt)» 

d.  KiMsandirTAs 

e.  Mi>re  qualified  personnel 

f.  Better  supply  supp»»rt 

g-  Other,  or  multiple  response 

h.  No  response 

Total  Number  of  Resjiondents  Per 
('ategory  • 


5H.J 

66.7 

47.7 

6X.2 

71  4 

25.0 

33.3 

42.1 

31.S 

28.6 

16.7 

0,0 

10.5 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

27.8 

10,5 

4.6 

7.1 

66.7 

22,2 

47.4 

13.6 

57.1 

25.0 

.38.9 

26.3 

.36  4 

21.4 

8 3 

5.6 

15.8 

27.3 

14,3 

0.0 

5.6 

0,0 

18.2 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

25.0 

33.3 

26.3 

22.7 

28.6 

16.7 

1 1.1 

5.3 

0.0 

14.3 

58.3 

55.6 

52,6 

63.6 

57.1 

0.0 

0.0 

15.8 

4.6 

0,0 

0.0 

0.0 

0.0 

9 1 

0 11 

0.0 

0.0 

0.0 

0.0 

O.o 

0.0 

0.0 

10,5 

■M 

28  6 

50.0 

33.3 

10.5 

27  3 

28.6 

8.3 

44.4 

31.6 

50,0 

21.4 

41.7 

16.7 

47.4 

1 3.6 

14.3 

0.0 

0.0 

0.0 

0.0 

7.1 

0.0 

5.6 

O.o 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

7.1 

16.7 

16.7 

15.8 

18.2 

28.6 

16.7 

55.6 

63.2 

54.6 

35.7 

16.7 

111 

5.3 

18,2 

14,3 

25,0 

5.6 

0.0 

0.0 

7.1 

16.7 

III 

10.5 

9.1 

7.1 

8,3 

0.0 

5.3 

0.0 

0.0 

8.3 

0.0 

5 3 

9.1 

7 1 

8.3 

II  1 

5.3 

9.1 

7.1 

8.3 

5.6 

0.0 

9.1 

14  3 

16  7 

16.7 

10.5 

27.3 

35.7 

25.0 

16.7 

52.6 

27.3 

35.7 

8 3 

22,2 

21  1 

13.6 

0.0 

25  0 

27.8 

0.0 

4 6 

0.0 

0.0 

0.0 

5.3 

0.0 

0,0 

12 

18 

19 

22 

14 

82.4 

58.3 

91.7 

70.9 

88  5 

1 1.8 

41.7 

0.0 

23,4 

7 7 

5.9 

0.0 

0 0 

2.1 

3.9 

0.0 

0.0 

0.0 

0,7 

0.0 

0,0 

0.0 

8.3 

2.8 

0.0 

29.4 

12.5 

8.3 

13.5 

7.7 

1 1.8 

25.0 

0.0 

39  7 

19.2 

47.1 

37.5 

75.0 

31.9 

65.4 

0.0 

25.0 

8,3 

7.8 

7.7 

1 1.8 

0.0 

0,0 

4.3 

0.0 

0.0 

0.0 

8.3 

2.8 

0.0 

35.3 

16.7 

25.0 

20,6 

7,7 

0.0 

4,2 

8.3 

15  6 

0.0 

58.8 

75.0 

.6  7 

51.8 

76,9 

0.0 

4.2 

0.0 

5.7 

15  4 

5.9 

0.0 

0,0 

2.8 

0.0 

0.0 

0,0 

0.0 

3 6 

0.0 

1 1.8 

16,7 

25.0 

128 

19.2 

29  4 

417 

58,3 

32.6 

46  2 

52.9 

41.7 

16.7 

40.4 

30  8 

5.9 

0.0 

0.0 

9.9 

0 0 

0.0 

0.0 

0.0 

0.0 

3 9 

0,0 

0.0 

0.0 

4.3 

0.0 

0.0 

0.0 

0.0 

3.6 

0.0 

47.1 

33.3 

41.7 

29.1 

34,6 

23.5 

41,7 

16.7 

38.3 

.30.8 

17.7 

4.2 

25.0 

7.1 

19.2 

5.9 

8 3 

8.3 

2.1 

0.0 

5 9 

12.5 

8.3 

14.9 

15.4 

0.0 

0.0 

0.0 

5.0 

O.o 

0.0 

8.3 

0.0 

5.7 

3.9 

5 9 

4 2 

0.0 

9.9 

15  4 

17  7 

4.2 

25.0 

10.6 

3.9 

15.3 

20.8 

33.3 

17.0 

23  1 

23.5 

20.8 

16.7 

29.1 

23.1 

0.0 

29.2 

16.7 

1 1.4 

23  1 

17.7 

12.5 

8.3 

12.1 

7.7 

0.0 

0.0 

0.0 

4.3 

0.0 

17 

24 

12 

141 

26 

Table  3 {ConiiniicJ) 


AFSC 

QuMtioni 

325X0  325X1  321X0  321X1  321X4  423X1 

423X1  423X3  431X1  421X2 

.11. 

Do  you  prefer  to 

j.  1 s e 1 1 1 A s tor  all 

trout'lcsluH»lm)'  tasks 

17.1 

6.1 

4.1 

14.1 

10.0 

15  4 

2S  6 

12.5 

21.6 

2S.6 

b 1 sc  I n As  !t»i  inlretjucnl 

troub|c«vh(Hitjn>!  tasks  only 

IS  2 

18. H 

27.1 

42.4 

20.0 

10  s 

42.4 

25  0 

IS  4 

42  4 

X.  1 sc  1 r 1 As  tor  the  most 

i 1 1 1 c u 1 1 t r o u b 1 esh  o otin^i 
tasks  only 

IS. 2 

41.S 

4.1 

35.7 

10.0 

46.2 

214 

50.0 

43.2 

2S  6 

d.  Dcvclt'p  own  troublcsliootmj: 

strategy  ami  not  use  1 I'l  Vs 
at  all 

16  4 

IK. 8 

54.5 

7.1 

40.0 

7 7 

7.1 

12.5 

13  5 

0.0 

e.  Other,  or  multiple  response' 

().() 

12.5 

0.0 

0.0 

0.0 

0.(1 

0.0 

0.0 

2.7 

0.0 

34. 

How  do  you  feel  about  being 
rci]uircd  to  usi-  I 1 I Vs  for  all 
troubleshooting  jobs'* 
a.  n eased 

27.1 

6.1 

0.0 

7.1 

10.0 

15.4 

7.1 

25.0 

21.6 

2S  6 

b.  Mostly  pleawd 

27.1 

12.5 

0.0 

21.4 

30.0 

30.S 

42.4 

50.0 

412 

42.4 

c.  Sornew hat  irritatetl 

4 1 

41.S 

.16  4 

50.0 

40,0 

IS. 5 

42.4 

25.0 

24.7 

14.3 

d.  Irritated 

16.4 

17  5 

61.6 

21.4 

20.0 

15  4 

7.1 

0.0 

5 4 

14  3 

c.  Other,  or  multiple  respHinsi' 

n.o 

0.0 

0.0 

0.0 

0.0 

0.0 

0.(» 

0.0 

0.0 

0.0 

15. 

lki  I n As  lead  to  a>rrec1  isolation 
ol  the  problem** 
a.  Yes,  always 

4.1 

0.0 

0.0 

7.1 

0.0 

0.0 

7.1 

0.0 

S 1 

14  1 

l>.  I'sually 

16  4 

37.5 

27.3 

71.4 

10.0 

46.2 

714 

50.0 

45  4 

S5  7 

c.  Sometimes 

27  1 

.50.0 

.16.4 

21.4 

70.0 

46.2 

21.4 

50  0 

40,5 

0.0 

d.  Scldijm 

27.1 

I2.S 

.16.4 

0.0 

0.0 

7.7 

0.0 

0.0 

5.4 

oil 

e.  Other,  or  multiple  resjH>nse 

(1.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

16. 

Do  1 n As  acquire  more  or  less 
time  to  troubleslu*t)t  a problem** 
a.  Ia’ss  time  is  required  using 

LHAs. 

45.5 

12.5 

9.1 

2S.6 

20.0 

15.4 

35.7 

12.5 

32.4 

42  4 

b.  About  the  same  amount  of 

lime 

27,1 

62.5 

27.3 

42.4 

30.0 

1S.5 

oc 

S7.5 

40,5 

42.4 

c.  More  time  is  res]uired  when 

using  III  As 

27.3 

25.0 

6.1.6 

2S.6 

50.0 

46.2 

35.7 

0.0 

IS. 4 

14  3 

d.  Other,  or  multiple  respoase 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0  . 

0.0 

0.0 

S.l 

0.0 

Total  Number  of  Respondents  Per 
Category 

1 1 

16 

II 

14 

10 

13 

14 

S 

.17 

/ 

To  What  Degree  were  JGMs  and  LTTAs  Accepted  by  Maintenance  Personnel? 

The  questionnaire  results  indicate  that  the  technicians’  attitudes  toward  the  J(iMs  and  LTTAs  were 
generally  favorable.  Acceptance  of  the  new  job  aids  by  maintenance  personnel  is  evidenced  by  the  responses 
to  several  questions  designed  specifically  to  elicit  such  infonnation.  The  results  to  questions  I and  I? 
indicate  that  the  technicians  not  only  liked  the  JGMs,  they  preferred  tlieni  over  tlie  traditional-style  TOs 
and  checklists.  In  response  to  question  I,  93.4%  of  all  technicians  surveyed  indicated  tliat  tlie  new  guides 
were  satisfactory  - at  least  as  good  as  the  old  TOs,  while  78.7%  actually  indicated  that  they  liked  tlie  JGMs 
more  than  the  old  TOs.  These  results  were  relatively  consistent  for  all  groups  of  technicians.  The  results  of 
question  12  indicate  tliat  53.3%  of  all  the  respondents  preferred  to  use  JGMs  rather  tlian  traditional-style 
T(^  or  checklists.  TTie  percentage  that  chose  JGMs  was  more  than  twice  the  percentage  that  chose  either  of 
the  other  response  alternatives.  Although  an  examination  of  the  results  by  APSC  shows  a significantly  wide 
range  in  percentage  of  responses  (26.3%  to  83.3%),  all  but  two  of  the  groups  (AI  SCs  328X0  and  328X4) 
chose  JGMs  as  their  first  preference.  The  two  remaining  groups  chose  JGMs  as  their  second  preference.  (Sec 
Appendix  D for  a listing  of  AFSC  titles). 
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Tt\c  IcJimcians  survi’yed  further  indicated  their  preference  for  J(iMs  when  MS')?  resprindcd  that  tfiey 
would  “ . . reconiniend  that  JtiMs  be  purchased  for  use  in  their  shop  “((piestton  2d)  lor  at  least  some 

tasks.  Ifiirty  tlirec  i>ercent  of  these  responded  that  they  would  recommend  JCiMs  for  all  of  their  shop  tresks. 
Tire  technicians'  rest^onses  to  (luestion  24  show  a similar  attitude  ol  acceptance  toward  I.T'l /\s 
.\pproximateK  Hd'?  resininded  that  they  would  recommend  the  purchase  ol  1 T1  As  for  at  least  some  of 
their  sliop  troublesliootmj!  tasks,  while  28. 7'^  of  these  responded  that  they  would  recommend  I I I As  lor 
all  trouhlcslioolmg  tasks.  In  consideralion  of  the  poor  condition  ol  the  ITTAs  (in  terms  of  errors, 
incompleteness,  etc.)  and  the  relatively  little  use  they  had  received  at  the  lime  the  Job  (luide  Ouesliormaire 
was  admini.stered.  the  strongly  favorable  attitude  toward  I H As  is  somewhat  surprising.  It  is  considered 
tliat  tliese  results  probably  indicate  the  technicians’  acceptance  of  the  geneial  lo  ’ic  tree  concept  for 
troubleshooting  data  rather  than  their  acceptance  of  the  ( -141  l.T!  As  specifically. 

Additional  evidence  of  maintenance  personnel's  acceptance  of  the  new  job  aids  is  found  in  the  results 
to  i)uestiori  l‘>.  llie  results  indicate  dial  83. 5',^  of  all  respondents  felt  they  used  JfiMs  at  least  as  much  as 
they  used  the  old  TOs.  and  35.4(?  of  all  die  respondents  felt  they  actually  used  the  JGMs  more.  Only  1 5.3^^ 
felt  they  used  the  JCjMs  less  than  hey  used  the  old  TOs,  Tliese  results  indicate  that  J(iMs  are  making  a 
favorable  contribution  to  the  solution  to  the  persistent  maintenance  problem  of  getting  technicians  to  use 
technical  data. 

It  IS  interesting  to  note  that  significant  differences  are  observed  among  the  results  to  question  l‘i  for 
specific  categories  of  maintenance  personnel.  Wliile  Mi.T/r  of  the  technicians  in  AI  SC  group  423X3  felt 
they  ased  JGMs  more  than  they  used  the  old  TOs.  only  11.1  of  the  AI  SG  group  325X1  felt  they  used 
J(iMs  more  and  16.7'^  of  the  same  group  felt  they  used  JGMs  less  than  they  used  the  old  TOs.  It  is  also 
interesting  to  note  die  range  and  distribution  of  the  results  for  the  Skill  level  groups.  Tlie  3-level  group  has 
the  higJiesf  percentage  (‘•d. G?)  and  the  7-  and  9-level  firoup  has  the  lowest  percentage  (2t>,8'7)  o) 
technicians  who  lelt  they  used  the  J(iMs  more  than  they  ased  the  old  lOs.  'fliis  distribution  of  results  lends 
support  to  the  belief  that  the  JGMs  are  most  appropriate  for  inexperienced  personnel.  However,  caution 
must  be  exercised  in  interpreting  this  result  since  it  may  be  inlliienced  by  the  fact  that  the  old  TOs  may 
have  been  withdrawn  before  many  of  the  3-level  technicians  had  acquired  much  experience  with  them. 

Hie  techriiciaiis  further  indicated  a favorable  attitude  toward  JG.Ms  througli  d'.eir  responses  to 
questions  28  and  29.  Of  all  die  technicians  surveyed,  36.9')!  preferred  to  use  JGMs  for  routine  jobs 
(question  28).  rather  than  traditional  TOs  ( 1 3.1 ),  checklists  (33 .4^7  ) of  very  general  procedures  ( 10  8'?  ). 
Tlie  results  lor  rioriroutine  jobs  (question  29)  show  an  even  stronger  preference  for  KiMs  (58'“)  than  for 
the  other  job  aids,  with  the  second  higliest  percentage  ( 22.39f ) showing  a preference  for  traditional  TOs.  An 
examination  of  die  results  to  question  28  by  AbSC  sliows  some  signiftcatit  differences  between  groups.  The 
jiercentage  of  respondents  who  preferred  JfiMs  for  routine  jobs  ranges  from  21.4'3  ( AI  SC  328X4)  to  75% 
( AI  SC  423X3).  niere  is  relatively  little  variation  among  the  AI  SC  group  results  to  question  29.  Tlie  J(iMs 
were  preferred  for  nonroutiiie  jobs  by  the  majority  of  all  the  AI  SC'  groujrs.  It  is  interesting  to  note  that,  as 
a lota)  group  and  when  grouped  by  Al'SG,  the  majority  of  the  technicians  preferred  to  use  JGMs  for  the 
jobs  widi  which  diey  were  not  familiar. 

Tlic  most  negative  responses  toward  JliMs  were  obtained  in  answer  to  question  30  which  asks,  “How 
do  you  leel  about  being  required  to  use  JGMs  for  every  job?’’  Just  over  50^  of  all  the  technicians  surveyed 
indicated  that  they  would  be  irritated  or  somewhat  irritated  by  such  a rerjuirement  However,  in 
interpreting  these  results,  it  sliould  be  noted  that  a significant  number  of  technicians  resist  using  technical 
data  of  any  kind.  TJius,  the  results  obtained  may  reflect  the  resistance  to  any  requirement  to  use  any 
technical  data,  rather  than  resistance  to  or  dislike  of  JGiMs.  In  fact,  in  considerir.g  this  natural  resistance, 
die  4(>.9%  of  the  technicians  who  indicated  that  diey  would  be  pleased  or  mostly  pleast^l  by  die 
requirement  to  use  JGMs  for  every  job  may  be  surprisingly  high. 

More  indication  of  the  technicians’  acceptance  of  J(iMs  and  ITT  As  is  found  in  the  results  to  question 
32.  When  asked  which  of  six  specific  altomatives  they  believed  would  most  impiove  die  efficiency  of 
maintenance  operations,  the  technicians’  riKist  frequent  response  was  “More  qii.alified  personnel  ’’  Tlieir 
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second  most  frequent  tes[X)nse  (by  <'nly  6 .1%  fewer  response)  was  “J(iMs  and  l.'ITAs.”  Ttie  inaiRin 
between  the  percentage  for  the  second  choice  and  the  percentages  for  the  remaining  four  alternatives  was 
more  than  twice  the  margin  between  tlie  first  and  second  choices.  When  the  results  to  question  .12  arc 
examined  according  to  Af'SC,  considerable  variation  is  noted.  Die  response  percentages  for  “More  qualified 
personnel”  range  from  16,7%  to  52.6%,  and  the  percentages  for  “J(iMs  and  l.TTAs”  range  from  10.5%  to 
.15.7%.  However,  botli  alternatives  were  chosen  by  the  higlicst  or  second  higticst  percentage  of  technicians 
for  most  of  the  AI  SC  groups. 

Several  questions  were  siKcifically  designed  to  detennine  which  characteristics  of  the  JtiMs  and 
I IT  As  would  intluence  their  acceptance  by  maintenance  ixrrsonncl.  Questions  2,  7,  9,  1.1,  15,  26  and  27  all 
deal  with  specific  characteristics  of  the  manuals. 

1 Size.  Tlic  results  for  question  2 show  that  87.6%  of  the  technicians  surveyed  indicated  that  the 
si/e  of  the  JQMs  was  satcsfactory  or  just  right.  Also,  as  shown  by  the  results  of  question  1 .1,  si/.e  was  one  of 
the  two  characteristics  which  were  most  frequently  chosen  by  technicians  as  the  best  feature  of  the  JGMs. 

2.  Sitp-hy-Slc/)  lnstnn  tiom.  As  indicated  by  the  results  for  question  25,  the  majonty  of  all  the 
technicians  (65. ,1%)  liked  the  stci>by-step  instructions.  Of  the  remaining  technicians,  27.4%  were 
indilterent  and  only  5.1%  indicated  an  actual  dislike  for  the  instructions.  Tlie  step-by-step  procedures 
teature  was  also  one  of  the  two  characteristics  which  were  most  frequently  chosen  by  technicians  as  the 
best  Icaturc  ol  the  JtiMs  (question  1.1). 

.1.  Illmtratiims.  Most  ot  the  technicians  surveyed  (70.4%-)  also  liked  having  detailed  illustrations 
keyed  to  the  step-by-step  procedures  (question  27).  Only  2.9'1.  actually  disliked  the  illustrations  and  24.8% 
responded  indifferently.  In  response  to  question  1 5,  99%  of  all  the  technicians  indicated  that  the 
illustrations  were  helpful,  even  thougli  ,11.5%  of  them  did  not  think  the  illustrations  were  usually  necessary 

4.  Duall.cvcl  /’canin’.  Attempts  to  measure  responses  to  the  dual-level  feature  of  the  guide 
(question  9)  were  hindered  by  the  fact  that  most  of  the  technicians  surveyed  did  not  know  wluit  tlie  feature 
was  However,  some  measure  ot  maintenance  personners  reaction  to  tlie  dual-level  feature  can  be  obtamecl 
from  the  results  to  question  I 1 Ttiose  results  indicate  that  79.1%  of  the  technicians,  at  least  some  of  the 
time,  used  the  procedure  headings  as  check  lists.  Since  such  usage  is  the  intent  of  the  dual-level  feature,  it 
appears  that  the  technicians  did  accept  and  use  the  feature,  even  if  they  did  not  know  what  it  was.  Tliis 
finding  also  is  supported  by  the  results  of  the  interviews  and  observations,  which  indicate  that  the  dual-level 
concept  was  received  very  well  and  may  have  contributed  significantly  to  the  accepjance  of  flic  KJMs. 

5.  .\um/n’r  a/  linoks.  One  characteristic  of  the  KiMs  which  had  a negative  infiuence  on  their 
acceptance  by  maintenance  personnel  was  the  fact  that,  for  many  of  the  jobs,  more  than  one  book  (or 
volume)  is  required.  Hus  negative  miluence  was  identified  througli  the  results  to  the  interviews  and 
observations,  as  well  as  througli  the  results  to  question  7 ol  the  Job  (luide  Questionnaire.  In  responding  to 
question  7,  52.2%  ol  all  the  technicians  indicated  that,  occasionally,  too  many  hooks  were  required  for  one 
job.  An  additional  114'!  ot  the  technicians  responded  that,  most  of  the  time  or  always,  too  many  btxiks 
were  required  lor  one  joh  Considerable  variation  is  noted  among  the  results  for  the  Al'SC  groups,  with  the 
|K‘rccntagcs  ranging  from  11.1%  of  the  AI  SC  421X1  group  to  91.5%  of  tlie  ACSC  125X0  group  who 
responded  that,  occasionally  or  always,  loo  many  biMiks  were  required  for  one  job.  However,  it  appears  that 
most  of  the  At  S(  groups  with  a large  j'ercenlagc  of  respondents  indicating  that  tixi  many  books  are 
required  are  the  At  SCs  whicti  involve  performing  mainlcnance  on  several  subsystems  of  the  aircraft. 

To  What  Degree  Did  Maintenance  Personnel  Consider 
the  J(iMs  and  I,  IT  A.s  to  be  Usable'’ 

Tlie  Job  (iiiide  (Questionnaire  results  indicate  that  most  of  the  technicians  surveyed  felt  the  JGMs  and 
I TT  As  were  usable  and  generally  considered  them  to  he  belter  than  the  tradiational  TCh.  The  results  for 
question  18  show  that  59.4%  ol  all  the  lectiniaans  cxinsidered  the  JGMs  to  be  a better  source  of  job 
information  tlian  were  tlie  old  fOi  Althougli  the  results  for  specific  categories  of  maintenance  personnel 


49 


show  a wide  range  of  ircrccntages,  at  least  50'"  of  the  [XTSonnel  in  eaeh  group  arnsidered  the  J(.Ms  to  be 
better  ilian  the  traditional  K)s  It  is  most  interesting  to  note  the  range  and  distnbution  ol  the  results  by 
skdl  level.  Tlic  iierecnlage  of  respondents  who  consideted  the  JtiMs  to  be  a better  job  inlorrnation  source 
than  were  the  old  lOs  increased  as  the  experience  level  of  tlic  technicians  decreased  Tins  trend  supports 
the  contention  that  JtiMs  arc  especially  suitable  for  use  by  relatively  inexix-ricnced  technicians. 

l urther  evidence  of  the  usability  of  KlMs  is  provided  by  the  results  of  question  25  t)l  the 
respondents,  only  4 K'"  indicated  that  the  Jti.Ms  and  ITT As  did  not  help  them  do  their  jobs  at  least  as  wen 
as  did  the  traditional  ItK  Ot  diose  who  responded  that  tlie  JtjMs  and  I TIAs  did  help  them,  4ri.2'^ 
indicated  that  the  JtiMs  and  I 1 TAs  actually  helped  them  do  a better  job  tlian  did  the  old  [l)s  'Mien  the 
results  for  question  25  arc  examined  according  to  AhSC,  it  is  noted  that  llie  percentage'  ol  technicians  who 
indicated  that  the  JtiMs  and  f IT  As  helped  them  do  tlicir  job  at  least  as  well  as  did  die  old  Tt)s  arc 
relatively  die  same  for  all  groups.  However,  there  are  significant  differences  between  the  percentages  who 
indicated  that  the  new  joh  aids  helped  them  do  their  job  better.  It  is  also  interesting  to  note  that  an 
examination  by  skill  level  ol  the  results  for  question  25  reveals  a trend  similar  to  die  trend  in  the  skill  level 
group  results  for  question  IX.  IV-  [rercenlagc  of  technicians  who  responded  that  die  JfiMs  and  TIT, As 
helped  them  do  their  job  better  than  did  the  old  T()s  increased  as  the  experience  level  of  the  technicians 
decreased.  Again,  this  trend  supports  the  contention  that  JGMs  and  IlTAs  are  especially  suitable  tor 
relatively  mcxjx’nenced  technicians. 

Ilierc  are  several  characteristics  of  the  JGMs  and  LTFAs  which  directly  or  indirectly  affect 
their  usability.  (Questions  .T  4.  5 and  b were  designed  specifically  to  deal  with  those  characteristics. 

1.  .Ukyuaev  and  Accuracy  of  lujoramtion.  Tlic  results  of  question  4 show  that  ‘J0.2'T  of  the 
lechniciat.s  surveyed  felt  the  job  guide  procedures  contained  at  least  enough  infonnation  to  be  useful 
Tliirty  nine  pctceni  of  those  technicians  actually  felt  the  procedures  contained  most  or  all  of  the 
infonnation  needed  to  do  their  job.  About  of  all  the  technicians  also  felt  that  most  or  all  of  the  JGM 
priKcdurcs  were  correct  (question  5). 

Accuracy  is  especially  e-.scntial  in  I TT As,  since  tliey  must  lead  to  ilie  solution  o(  almost  all 
troublcsliootmg  problems  to  be  effective.  Hie  results  for  question  .'5  show  that  54.8'T  ot  the  technicians 
surveyed  felt  the  LIT  As  always  or  usually  led  to  correct  solution  ol  the  problem.  Ai  examination  of  the 
results  by  ATSC  shows  a range  of  percentages  of  technicians  who  responded  as  above  from  27. .Vt  (,AI  S( 
328X0)  to  78.5'X  (Al  SCs  328X1  and  423.X1 ).  lliesc  results  clearly  indicate  that,  at  the  time  ol  this  study, 
the  LTTA  did  not  adequately  satisfy  the  criteria  for  effective  isolation  of  malfunctions  lliis  finding  is  not 
surprising  since  the  I TT As  had  not  been  adequately  verified  or  tested  before  ihey  were  imirlenientcd. 
(('omplete  verification  of  procedurali/ed  troubleshooting  data  is  not  feasible).  In  addition,  infonnation 
obtained  during  tlic  interviews  and  observations  indicated  that  the  ITT  As  had  not  been  used  extensively 
during  the  early  stages  of  implementation,  ('onsequently,  many  of  llie  errors  had  not  been  identified  or 
corrected. 

2.  niustratu>ns.  One  of  the  key  elements  of  the  JGM  concept  is  the  extensive  use  of  goiKi 
illustrations.  Ouestion  3 dealt  with  the  quality  of  the  illustrations  in  tlie  ( -141  Job  Guide  Manual,  llie 
results  of  lliis  question  show  that  85. d*}?  of  all  the  technicians  felt  the  illustrations  were  okay  oi  excellent 
(22.5'lf  of  tJiem  felt  the  illustrations  were  excellent). 

3.  Oanty.  Of  the  technicians  surveyed.  35.4%  indicated  they  never  experienced  difficulty  in 
understanduig  the  priKcdures  in  the  JGMs  (question  5).  However,  61.2%  indicated  that  tliey  occasionally 
experienced  difficulty  and  2. 87f  indicated  that  they  exjx'rienced  difficulty  most  or  all  ol  the  time  It  cannot 
be  detemiined  from  tJie  available  infonnation  how  serious  the  clarity  problem  may  be,  but  the  general 
accepiancc  of  die  new  job  guides  and  their  indicated  usability  suggest  that  the  problem  may  not  be  too 
senous.  However,  tlie  results  do  indicate  that,  at  the  time  of  this  study,  the  goal  ol  KX)"';  clarity  in  writing 
had  not  been  obtained. 
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( iinipariMin  of  Ri'snlts  from  Bofom  and  Mlcr  Implcmontalion 

Anotlicr  jiurposo  of  the  studs  svas  tt>  determine  il  the  JtiMs  and  1 I I As  luHiUed  the  cx[X’ctations 
expiessed  b>  the  technicians  KMoie  the  ness  aids  had  been  implemented  Tables  4 and  5 provide  a 
comparison  ol  the  results  lor  the  eight  (]Ui'stions  included  m the  lechnical  Oidci  (jucslionnaire  ( Appendix 
A)  tx'tore  iinplemeiitation  and  in  the  Job  (lUide  (Questionnaire  (Appendix  B)  after  im[ilenieiitation  ot  the 
J(tMs  and  I l IAs  1 he  results  are  piesenled  in  lahle  4 bs  si|uadron.  grade  level,  and  as  the  conitnned  total 
of  respondents  ITom  ( liaileston  and  Noiton  Al  Bs.  Hiey  are  presented  in  Table  5 by  grade  level 

IJie  results  for  the  pre  implenientation  questionnaiie  indicate  that  the  technicians  liked  the  ness  )oh 
guide  coiKcpt  and  esixclcd  to  like  the  KiMs  and  111  As.  Ilossevei.  the  results  for  the  same  questions  on 
the  post  iniplementation  questionnaire  indicate  that,  althougli  the  J(lMs  and  I TI  As  vsere  geneially  well 
accepted,  they  did  not  lulls  meet  t'le  technicians'  exix’ctations.  Ilie  results  for  all  eiglit  questions  show  a 
decrease  m the  percentage  ol  tavoiable  responses  to  JtiMs  and  l.Tl  As  after  implcmcnitation  l or  example, 
before  implementation.  7H1'  ol  all  the  technicians  surveyed  expected  the  J(>Ms  and  ITT  As  to  help  them 
do  their  |ob  better  than  did  the  traditional  T()s  (question  25).  After  implementation,  only  4(v2'7  of  all  the 
technicians  felt  that  the  J(  iMs  and  1 TT  As  had  indeed  helped  them  do  their  job  better. 

.Althougli  the  cause  of  the  decrease  in  favorable  attitudes  toward  the  new  ptb  guides  is  not  obvious,  it 
could  have  Ix’en  due  to  implementation  problems  or  the  uiicorrected  errors  m the  manuals.  Other  causes 
may  be  indicated  by  sixne  of  the  clianges  recommended  by  the  technicians  in  their  responses  to  (|ucstion  .17 
and  by  their  miscellaneous  comments  made  as  additional  responses  to  the  multiple  choice  questions. 

J’ahk'  4.  I’ercentage  of  Subject  Responses  to  Selected  (Questions  Administeied 
Before  and  After  Job  fiuide  IniplemeiKalion  ( by  Base  and  b\  Stjuadnui) 
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keyed  to  the  step-by-«itep  procedures’’ 
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e. 

Other,  or  multiple  response 

2.0 

4 1 

4.7 

6 4 

0.0 

0.4 

2.6 

4 X 

f. 

No  responv 

1.6 

1.6 

0 0 

0 II 

1 4 

14 

4 4 

2 4 

I 
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lah^c  4 {0>nttnucd) 


Squadron 

cafb  ii 

NAFB 

AMS  FMS 

OMS 

Qu«stlonia  ft  b 

B A 

A 8 A 

B A 

2^ 

for 

a. 

non-n»utme  jobs 
Iraditional  I() 

16  3 

22.3 

17  3 

28.7 

IH  0 

21  3 

1 3 11 

17  1 

h 

C'heckli.sl 

10.2 

10.2 

124 

7.9 

q 0 

S b 

III  4 

17  1 

c 

Job  (iuidc  Manual 

66.3 

5H.0 

bT  0 

56.4 

b4  1 

66  7 

70  1 

51  4 

d. 

Very  gcnc[;il  instructions 

4.1 

5.7 

3.7 

4 0 

4 

(.  5 

2 t. 

t,  “• 

c. 

Other,  or  multiple  response 

1.6 

2.5 

3 0 

2 b 

M 0 

0 o 

t h 

f. 

No  resj»onse 

1 .b 

lb 

1 A. 

0 0 

0 0 

0 9 

\ q 

1 K 

jn. 

flow  do  you  feel  about  iMrinj;  required  to  use 
iCiMs  f(?r  every  job^ 
a.  Pleased 

35  4 

13  1 

21.0 

7 9 

44  q 

lh.5 

tq  0 

12  4 

b. 

Mostly  pleased 

41  1 

3 3.H 

4b  9 

29  7 

IH  5 

44  4 

,7  7 

2b  7 

c. 

Somewhat  irritated 

17.5 

37  3 

27.2 

37  h 

1 1.5 

29  6 

|5  », 

44  K 

d. 

Irritated 

4.S 

1 3 1 

3 7 

22  H 

\.9 

5 6 

‘ 2 

1 1 4 

e. 

Other,  or  multiple  response 

0.(1 

Ob 

0 0 

1 0 

0.0 

o q 

O 0 

f»t| 

f. 

N<»  response 

1 6 

12 

1 O 

1 3 

It  q 

? b 

4 H 

31. 

UTiieh  would  be  the  most  helpful  to  you  in 
translcnmy  to  a new  aircraft'* 
a.  A'lC  school 

0.4 

1 9 

0 0 

1 O 

1 3 

1 9 

o o 

2 q 

b. 

IT  I)  School 

IK. 7 

2H  7 

12  4 

22  8 

19  2 

u \ 

24  ’ 

29  5 

c. 

OJ  I 

30.5 

3K  5 

42  I. 

44  b 

20  5 

^ 

2H  b 

38  1 

d. 

KiMsand  l.rrAs 

24  K 

10  K 

25  9 

1 3 9 

37  2 

1 1 1 

1 3 II 

7h 

c. 

(onventionaJ  If) 

O.K 

3 K 

2.5 

5 q 

110 

t 7 

0 II 

1 9 

!. 

Other,  or  multiple  response 

23.6 

13.4 

16  1 

9 q 

20  5 

14  8 

\2  S 

15  2 

R- 

No  response 

1.2 

2 9 

1 2 

2.0 

1 3 

1 9 

1 3 

4 K 

32. 

Winch  do  you  l>elKve  would  most  improve 
Ur*  efficiency  of  maintenanc'c  operations? 
a.  More  AlC  training 

1.6 

5 1 

2.5 

5 0 

0.0 

3 7 

1.3 

6 7 

b. 

Better  AT(*  training 

4 V 

H.b 

4 9 

7 9 

2.6 

5 6 

b.5 

12  4 

c. 

Better  conventional  K)s 

6.5 

9 6 

7 4 

H q 

b.4 

9 3 

6.5 

10.5 

d. 

JOMsand  I H As 

37,0 

217 

.39.5 

22  8 

.37.2 

25.9 

33.8 

16  2 

c. 

More  quaJirn’d  |»crsonncl 

1 1.4 

2K.0 

12.4 

.30  7 

10  .3 

22  2 

1.3.0 

31  4 

f. 

better  supply  supt>ort 

K.l 

13.7 

8 6 

1 1.9 

9M 

21.3 

5.2 

7.6 

K. 

Other,  or  multiple  response 

29.3 

11.2 

24  7 

119 

33  .3 

10.2 

31.2 

114 

h. 

No  response 

1.2 

2.2 

0.0 

1.0 

1.3 

1 9 

2.6 

3 8 

Total  nurnlHrr  of  Res|>ondcn!s  per  ('atej»ory  * 

246 

.314 

K1 

101 

78 

108 

77 

105 

*l)uf  t«)  sp4ce  lirniutiom.  the  questions  presented  in  the  lahles  have  been  abbreviated.  The  questions  are  presented  in 
tJieif  complete  on^ma)  form  ui  the  questionnaire  in  the  appimdix. 

of  tile  questions  whith  ate  stated  usirnt  present  verb  tenses  in  the  tables,  were  stated  usinn  future  verb  lenses 
in  the  TeclmiLal  ( hder  (Questionnaire. 

^ h resprcsenis  Before  and  Arcfireschis  After 
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/j/i/f  ^ IVrifiilagf  of  SiihjecI  Rcspoti>*‘s  to  Selected  <Jue^tio^^  Administered  Before 
and  After  Job  (iiiide  Implementation  (by  (trade I 


QuetOon*  ^ 


! 


2S.  I he  new  J(.M\  jmaI  I I I \s  help  you  do  your 
I(*h^ 

4 lie  I ter 

b.  \K*ut  the  v»me 

Sot  js  well 

d.  Other,  or  multiple  response 

e.  No  resjAonse 

l>o  s«*u  like  luvirv  det.iiled  sie|vhy*step 
mstruetions  su4.l1  js  tln*se  tound  in  tlie 

h. Ms* 

4 ^ es 

b M4kes  ru'  dittereiue 

4.  So 

d Other,  or  multiple  response 

c So  resj>(fnsi- 

27  !)..  y*'U  like  luvin^  detjiled  illust rjtioas 

keyed  to  the  step-hv-step  pro^xulures’ 

4.  Nes 

b.  M4kes  no  dilterenee 

L . Nil 

d Other,  or  multiple  res|>»jnsL' 

e.  Nf  respmse 

2h.  Nkliith  t>(v  «»l  tcehniud  data  would  you 
preler  to  uw  ’ I or  routine  jobs 
X Ir.iditioiul  i O 

b.  ( he^klist 

i.  lob  ( puide  Manuals 

d.  Very  jieneral  procedures 

e.  ihher.or  multiple  responds- 

I.  Stt  resp»tnsA* 

2^^  I or  non  routine  jobs 
a (radltiofial  lO 

b ( hei.klist 

I . Job  ( lUidc  Manual 

d.  Very  yeiKfal  instriKtHms 

e.  Other.  (»r  multiple  resj>onse 

t No  res|H>nse 

Ifl.  Ib»w  do  >(»u  feel  about  heirij'  retjuires!  to  use 
J(  »Ms  lor  every  job  ' 

a.  Heasesl 

b.  Mostly  pleased 

c.  Stunewhat  irritated 

d.  Irritated 

e.  tJiher.  or  multiple  rcspA»nse 

I No  resjiofisi' 

51.  VMiiih  would  the  most  lielptui  to  you  in 
transferring  to  a new  aircraft'’ 
a.  Air  school 

h I I D school 

c.  OM 

d.  J(  iMs  and  I I 1 \s 

e.  ( onventioiial  lO 

I.  Other,  of  rnuilipie  resjronse 

No  re\(>Miw* 


75.3 

51.1 

70.5 

4f.  5 

7>l  (1 

2H  »i 

7b. 2 

4 

20. H 

4(,.7 

IK  M 

4 b 5 

|5.K 

71  4 

2.VK 

4^  I 

2.0 

•»  ■> 

2 b 

5 

0.0 

00 

7 i 

0.0 

O.ll 

n 0 

o.O 

(1  (1 

0 0 

oil 

(1  (1 

2.0 

t».(J 

0.0 

1 b 

0 II 

0.(1 

V7 

H2.2 

71.1 

K5.0 

(.1  4 

•J2.I 

7K  b 

^0.5 

b t 4 

I2.^J 

2K.^# 

7.7 

2')  1 

5 i 

21.4 

0 5 

2 V2 

^.0 

0.0 

b 4 

7 '» 

0 0 

0 0 

0 (1 

7 

0.(t 

00 

fl.o 

II. (1 

0.0 

0.0 

0 0 

2 4 

0.(1 

0.0 

0.0 

1 l< 

2.b 

0.0 

0.0 

^ 7 

Kb  1 

77  K 

41.0 

(.  1 4 

47  4 

71.4 

4S.2 

75.6 

10.4 

21  1 

7.7 

.4.4  1 

o.(t 

2K.b 

4 K 

15  4 

5.0 

1 1 

0.0 

.4.'» 

0.0 

0.0 

0.0 

4.7 

0.0 

0.0 

0.0 

ll.ll 

0.0 

(kO 

0.0 

1 2 

0.0 

ll.ll 

15 

1 (, 

2.b 

0.0 

0.0 

4 7 

h 9 

K 4 

7 1 

15.(1 

5 .4 

7 1 

14  t 

15  4 

.47.6 

5K.4 

24.5 

415 

26. .4 

5(t  0 

47.b 

2b. H 

47.5 

40.0 

511 II 

.47.1) 

57.4 

55.7 

5K.1 

54.2 

5 II 

) 0 0 

4.11 

12.6 

5.4 

7 1 

0.0 

4,K 

1 .11 

2 ■> 

2.6 

2.4 

2.6 

0.0 

n 0 

4 S 

2.11 

0 0 

1 4 

1 6 

2.6 

0.0 

0 (I 

V7 

4.4 

1 H.4 

24  1 

22  1 

21.1 

2K.b 

14. ^ 

25  b 

14  4 

5.b 

5 1 

1 I.K 

5.4 

0.0 

14  ^ 

1 1 4 

b7.5 

bb.7 

66.7 

5K.5 

6 4.2 

57.1 

bl  .4 

4K  K 

^.0 

5 (4 

4.4 

b ^ 

11.0 

14  ( 

4.*; 

t 7 

0.0 

2 2 

I..4 

O.K 

7 4 

0 0 

0.0 

4 <# 

VO 

1 1 

ll.ll 

O.K 

2 (. 

II  0 

0.0 

5.7 

25.7 

10.(1 

41.0 

14  2 

50.0 

21 4 

2K  b 

1 4 4 

45.5 

511 

41  .0 

41  5 

24  0 

28  6 

47  b 

40  2 

2(1  X 

44.4 

15.4 

,45.4 

10.5 

42.4 

2 5.K 

.417 

5.4 

15.5 

1-5 

15.0 

K 0 

7 1 

o.O 

1 1 0 

0.0 

0.0 

0.0 

1.6 

0.0 

0 0 

0 0 

0 0 

2.0 

1 1 

1.5 

2,4 

2.b 

0.0 

00 

4 7 

0.0 

5.5 

0.0 

1.6 

2 6 

0.0 

0 0 

1 2 

17.x 

25.b 

16  7 

24  4 

21  1 

57.1 

|4  1 

44  2 

47.6 

44.4 

26  4 

46  2 

1X4 

2Kb 

5h  1 

47  X 

17.x 

10  0 

40  X 

12.6 

'1  6 

7 1 

2 5 s 

X 5 

0.0 

5.5 

2 6 

4 7 

0 0 

0.0 

0 0 

4 7 

25.7 

1 0 0 

21  X 

IX  1 

2 4 7 

7 1 

|4  1 

1 1 0 

1 .0 

5.5 

1 4 

2 4 

2 6 

0 II 

0.0 

4,7 

5.5 


■d 


Table  5 {ContmucJ) 


Grad* 

t «.  2 

4 3 

4 1 

5 

6 4 7 

4 14  9 

10 

4 1 1 

Question*  * 

B= 

A 

B 

A 

B 

A 

B 

A 

32.  NVliich  do  you  believe  would  most  impiovc 
the  cfTKiency  of  maintenance  operatmns? 
a.  More  ATC'  training 

0.0 

4 4 

13 

3.2 

0 0 

4 X 

4 K 

b. 

Better  AK’  training 

7.d 

11.) 

13 

10.2 

5,3 

14.3 

0.0 

2 4 

c. 

Hotter  ajnvcntional  TOs 

7,0 

lO.O 

7.7 

1 l.b 

n 0 

0.0 

4.K 

7.3 

d. 

K'.Msand  l i t As 

.TS.b 

2.V3 

41.0 

24  4 

34  > 

21  4 

33.3 

14.6 

e. 

More  qualified  pononncl 

7.4 

22.2 

15.4 

27  fi 

10,5 

35.7 

23  K 

34,2 

f. 

lU'fter  supply  support 

K.4 

14.4 

7.7 

1 1 K 

7,9 

21  4 

9 5 

14.6 

g- 

Other,  or  multiple  response 

.iO.7 

1 J J 

24.4 

9 5 

-'4.2 

0.0 

23. X 

13.4 

h. 

No  respt>nse 

1.0 

1.) 

1.3 

l.b 

2.b 

7 1 

0.0 

3 7 

Total  Numh<*r  of  RespomKmt.s  per  ( aie^ory  = 

101 

90 

7K 

127 

3K 

14 

21 

X2 

*lhic  t*.>  spite  limititions,  the  questions  presented  in  trie  tables  have  been  abbreviated.  Ttic  questions  arc  presented  in 
thc'r  cetiiiplctc  original  form  in  the  questionnaires  in  the  applendix. 

^ Sonic  ell  the  questions,  which  .ere  stated  usinjt  present  vinb  unises  in  the  tables,  were  stated  usinit  future  verb  tenses 
in  the  Technical  Order  t,hiestiotinaire. 
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Job  Guide  Manual  C hanges  Recommended  by  Mainlenance  Personnel 

TTic  oiien-ended  essay  ifueslion,  ,T7,  was  included  in  the  Job  (iuide  CJuestioi.naire  to  obtain  specific 
recommendations  from  the  technicians  on  how  to  improve  the  new  data.  Question  37  asks,  “If  you  could 
intluence  the  purchase  of  job  guide  type  manuals  for  a new  aircraft , what  changes  would  you  recommend'’” 
Althougli  the  specific  recommendations  were  too  numerous  for  a complete  lusting  in  this  report,  the 
following  paraphrased  responses  represent  the  most  typical  suggestions. 

1.  Provide  more  tJieory,  so  an  airman  can  understand  how  a system  works,  instead  of  just  how  it  is 
taken  apart  and  put  together 

2.  Job  guides  should  explain  why  an  item  is  being  removed  and  replaced.  They  should  also  explain 
the  primary  use  of  an  item. 

3.  Provide  more  information  on  the  aircraft. 

4.  Provide  more  details  on  systems  interface, 

5.  rXecrease  some  of  the  step-by-step  procedures.  Some  of  them  are  not  necessary. 

6.  Include  the  name  and  number  of  all  test  equipment,  primary  and  alternate. 

7.  There  are  easier  ways  to  accomplish  some  tasks  than  by  the  methods  presented  in  the  job  guides. 
Suggest  more  research  into  methods  for  doing  jobs. 

8.  Reduce  the  amount  of  operational  check  data  on  simple  systems,  such  as  ADI-'  systems, 

9.  Word  the  guides  more  clearly. 

10.  Provide  better  alignment,  if  possible,  between  illustrations  and  particular  steps. 

1 1 . Provide  a more  complete  cross-referencing  index  system. 

1 2.  Require  fewer  manuals  per  job. 

13.  Incorporate  all  data  related  to  a specific  task  in  one  section. 
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14.  IVcrcasc  menial  tasks  included 

1 5.  Decrease  repetition  of  menial  tasks  (i.c.,  refuel,  dcfuci,  etc.) 

I(i,  Include  trouhlesliootinj;  trees  witlnn  |oli  guides. 

n Put  repair  (removal  and  rei'lacement ) in  the  same  book  with  the  operational.phecks 

IH,  Have  one  hook  jx'r  system  which  includes  all  information  for  the  system. 

I‘).  IVovide  a checklist  to  supplement  job  (tuidcs. 

21).  I'se  checklists  lor  i|uick  operational  checkout  of  certain  systems. 

21.  IVovide  better  storage  places  for  the  manuals. 

22.  Improve  the  numbering  system  so  a specialist  can  IcKatc  his  job  guide  without  searching  Job 
guides  should  be  numbered  on  the  front. 

2.V  Provide  more  detailed  breakdowns  in  the  troubleshooting  manuals. 

24.  Provide  more  m-deplh  troubleshooting.  Hie  voltages  checked  still  leave  much  uncovered  for 
precise  work. 

2-‘i.  1 TTAs  do  not  covet  every  job  possibility,  nierefore,  they  should  be  used  as  a supplement  to 
lOs,  ratlier  than  as  a replacement  of  standard  POs. 

2b.  Die  pages  and  binders  need  to  be  more  durable. 

27.  Pile  pages  should  be  coated  with  plastic,  so  you  can  mark  your  spot  without  messing  up  the 

book. 

25.  Make  the  1 IP  As  more  detailed. 

2b  Train  individuals  m the  use  of  the  job  guides.  Show  them  why  they  are  better  and  how  they  can 
save  time. 

As  was  previously  mentioned,  many  respondents  wrote  additional  comments  next  to  their  responses 
to  the  multiple-choice  questions.  Samples  of  these  comments  arc  presented  in  Ap|x;ndix  F.  It  shiiuld  be 
noted  that  the  leclings  expressed  arc  not  necessarily  representative  of  the  feelings  of  all  respondents  Tliey 
merely  represent  the  feelings  of  those  who  took  time  to  add  written  comments. 

VI.  m.s(  ifssioN 

Althougli  many  problems  have  been  encountered  in  the  C-141  job  guide  program,  the  program  is 
considered  to  be  very  siiccessliil  overall.  Tlie  job  guides  have  been  well  accepted  by  tlie  technicians  and  are 
preterred  over  the  old  PO  by  many.  In  addition,  the  job  guides  have  proven  to  be  generally  more  effective 
than  the  conventional  'KK  that  they  replace,  llicy  are  considered  to  he  more  usable  than  the  PO  botfi  in 
terms  ot  convenieiice  for  tlie  user  and  the  ipiality  of  the  infonnation  provided  for  the  technicians.  Thus,  the 
major  goal  ol  the  program,  to  provide  improved  technical  data  for  the  ('-141,  has  been  achieved. 

Most  of  the  problems  encountered  in  the  program  have  been  or  are  being  overcome.  Most  of  the 
serious  errors  in  the  data  have  been  corrected.  A new  index  has  been  develo[>ed  to  include  the  MSIM  and 
(iAM  as  well  as  the  job  guides.  Policies  for  the  use  of  job  guide  manuals  have  been  clarified  and 
iinplemented.  And.  linally,  resistance  to  change  is  being  overcome  by  time. 

Other  problems,  however,  remain  unresolved  or  only  partially  resolved.  Tlie  training  problem  was 
never  satisfactorily  resolved  It  has  become  less  of  a problem  simply  because  technicians  have  learned  to  use 
the  data  Ihrougti  trial  and  error.  No  progress  has  been  made  toward  printing  the  job  guides  on  more  durable 
paper  or  binding  Iherii  in  more  suitable  binders.  Consequently,  the  attendent  problems  (lorn  and  missing 
pages,  broken  binders,  etc.)  remain.  Considerable  progress  has  been  made  in  correcting  errors  in  the  data. 
However,  errors  remain  (especially  in  the  troubleshooting  data)  which  must  be  corrected. 
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Tlic  1-141  )()h  piidc  ptopiani  lias  provided  many  valuable  lessons  tor  use  in  other  programs  to 
develop  and  miplemeni  job  guides  tor  other  systems.  A successful  program  is  dependent  upon  two  main 
factors,  the  development  ut  accurate,  effective  data  and  the  implementation  of  tlie  data  in  an  etTicient 
manner  w hich  docs  not  cause  ttic  teclinicians  to  be  “turned  otf"  by  minor  administrative  problems  before 
they  are  able  to  use  it 

Tlie  development  ol  the  data  is  the  most  critical  aspect  ol  the  progiam.  If  the  job  guides  are  not  ol 
good  quality  (etlective  procedures  and  relatively  error  free)  when  placed  in  the  field,  the  program  ha.s  little 
chance  of  success  lire  most  critical  step  in  the  development  of  the  data  is  the  establishment  of  contract 
requireninits  and  the  selection  of  a contractor  to  develop  the  data  Ihe  contract  lor  the  developmait  ot  the 
(141  data  contained  three  unique  requirements  which  arc  believed  to  have  cotitnbuted  significantly  to  the 
success  of  tlie  program.  Ilicse  were  a requirement  lor  a task  analysis,  iiithmited  access  to  the  aircraft  lor  the 
contractor  for  use  in  developing  and  testing  procedures,  and  a guarantee  requiring  the  contractor  to  correct 
any  errors  found  in  the  data  during  the  first  year  It  is  believed  that  the  guarantee  claicse  encouraged  the 
coiittaclor  to  place  greater  emphasis  on  qinility  control  in  the  development  of  the  data. 

Although  a task  analysis  is  not  a contract  requirement  for  most  technical  data  procurements,  it  is 
considered  to  he  an  essential  requirement  lor  Ihe  development  ol  |oh  guide  type  data,  llic  task  analysis 
priK'ess  provides  a means  of  develiquiig  a complete  data  base  Ironi  which  the  [ob  guides  can  be  developed.  It 
includes  procedures  lor  identifying  all  t.csks  to  be  covered  by  the  job  guides,  analy/ing  the  tasks  to  develop 
the  most  clficient  procedures  lor  accomplislimg  each  task,  identilying  tasks  and  special  equipment  required 
to  complete  each  task,  and  determining  Ihe  level  ol  detail  that  should  he  used  in  writing  the  procedures 
Ttic  data  ba.se,  produced  from  the  task  analysis,  establishes  the  final  requirements  for  developing  the  job 
guides  and  provides  most  ol  the  miorniation  reijuired.  Development  of  the  job  guides  then  becomes 
primarily  a process  ol  formating  the  data  and  providing  the  necessary  illustrations  and  support  intonnation. 

In  developing  job  guide  and  I H A type  teebmeal  data  it  is  highly  desirable  that  the  data  dcvelojicTs 
have  tree  access  to  the  sub|ect  equipment.  Allhougti  providing  Ihe  required  access  may  be  exjUT.sive  m 
some  cases,  it  is  believed  that  the  improved  quality  of  the  data  and  reduction  in  requiiemaits  lor  revisions 
more  than  justify  the  cost.  I’ermitting  the  task  analyst  and  technical  writer  to  have  access  to  the  equipment 
allows  them  to  actually  see  how  it  works  and  try  the  procedures  to  insure  that  they  aie  effective.  Dus 
access  also  allows  the  writer  to  try  several  jiossible  procedures  to  see  which  works  best  Wuhout  this  access. 
Ihe  analyst  and  writer  are  lorced  to  rely  on  engineering  drawings  or  jihotograj'hs  and  their  imaginations  to 
develop  the  procedures  Inevitably,  this  process  results  in  the  development  of  some  procedures  which 
require  revision. 

Once  the  data  have  been  develojied,  they  must  be  verified  by  tlie  procuring  activity  to  insure  accuracy 
and  completeness.  Since  accuracy  is  essential  for  job  guide  lyjre  data,  it  is  important  that  all  jnocediirc's  be 
given  “hand-on”  verification,  ilands-on  verification  is  the  most  effective  way  of  insunng  that  the 
procedures  are  technically  correct  and  effective.  Verification  of  procedures  should  be  accomjilishcd  by 
ficrsonnel  with  ex[x;riencc  levels  typical  of  the  intended  user. 

Ideally,  one  hundred  jicrcent  of  the  procedures  should  be  venfied.  However,  this  is  seldom  feasible 
since  sonic  tasks  cannot  be  verified  without  risk  of  damage  to  equipment,  risk  of  injury  to  personnel,  or 
excessive  cost.  Tins  is  especially  true  for  LIT As.  Verification  of  l.lTAs  requires  installation  of  faulty 
conijMinerils  which  may  cause  an  unsafe  condition  or  damage  other  components  of  the  system  Most  job 
guides  can  and  should  be  venfied.  Tlie  only  exceptions  sliould  be  in  cases  where  there  is  risk  of  damage  to 
the  eqiiijmietit  or  injury  to  (H’rsonnel,  or  for  infrequently  performed  tasks  which  will  be  very  expensive  to 
verify  (e.g.,  removal  of  a wing).  All  other  job  guides  should  be  verified.  Procedures  which  arc  not  vertified 
should  be  given  a very  thorougli  review  by  qualified  technicians. 

Kven  with  a thorougli  verification,  it  is  inevitable  that  some  errors  will  be  found  when  the  data  is 
implemented.  It  is  important  that  sjiecial  provisiotis  be  made  to  sjiced  up  the  ujidating  privess  until  most  of 
the  errors  arc  corrected.  The  procedures  for  identifying  and  correcting  errors  used  in  the  C-141  jnogram 
were  especially  effective.  Similar  procedures  should  be  used  for  other  job  guide  programs. 
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It  i!>  ici.i>i',iii/cd  lli.it  till'  task  ati.il>sis  puK'ciliircs.  provisioti  ol  aci'css  to  the  cqiiipineni , and  extensive 
seiiluatton  Miitiitk.iiitl>  iiiite.ise  the  eosi  ot  the  data  However,  tl  ts  believed  that  the  improved  (|iiallty  ol 
the  data  piodined.  lediived  reipiiieineiits  lor  iipdatiiii;  the  data,  and  the  positive  innuenee  ol  aeciirate  data 
on  user  aeeept.iiwe  more  than  jiistitv  the  addttioii.il  cost  Hus  appears  to  be  a near  classic  case  of  a 
lone-tcriti  icdiKtion  tn  litc  ..vcic  costs  with  the  .ulded  Icaliire  ol  eatly  acceptance  ol  the  data. 

Ihc  wiond  most  ciittv.il  step  in  the  |ob  giiulc  progratn  is  iinpleitientalion  ol  the  data  An  ellcctive 
iitipicnicti tatioii  pioi'iaiii  is  essential  lot  a smooth,  transition  to  the  new  svstem  A siiccessliil 
implcmcnt.it ion  is  dcpetuleiit  upon  clleclive  pioccihircs  to  accomplish  the  lollowinj:  (al  orient  and  train 
m.iintcnaiivc  ivrsomicl,  (hi  dcvclof)  aiul  vommiinicale  [lolicies  lor  iisinj:  the  data,  .iiul  (cl  make  Ihc  data 
coiivcnientlv  available.  Siivcessliil  implcmciilation  ol  improved  lechtiic.il  data  rei|iitres  carelid  plaiininj!  and 
ptcp.ir.i  tion  A thoioiich  implcmciil.it ion  plan  is  essciiti.il  Hie  rcvpiiiements  lot  .in  ellcctive 

impicmciil.ilion  arc  ihsciisseil  in  detail  in  Sections  III  and  l\  and  \p|K'iuh\  ( Hiey  will  nol  be  discussed 
liiithct  here  llowcvci.  the  impoiiaiice  ol  an  ellcctive  impicmcni.ilioii  proeram  caniioi  be  ovcra.'mphasi/ed. 

Kccommciulalions 

Ikiscil  on  the  liiulings  ol  the  sliuly . itic  lollowinc  tecommendalions  are  made  lor  use  by  orcani/alions 
V oiisidc r iiii;  the  ptoiiiiemcnl  ol  |ob  ytiidc  type  icchmcal  data  lot  new  ot  cMstiny  systems 

Kccommeiulations  .ipplsiiic  spcvilically  lo  the  ( 141  ptoutam  wcie  m.ulc  available  to  MAC  and  Al  1C  at 
the  end  ol  I’hasc  II  and  ni.isv-  III  llicv  .ire  simimaii/cd  m Scclioii  III  and  1\ 

1.  Ihc  n>b  ciiidcs  should  be  based  on  a ihoioiieJi  task  analysis  Ihc  task  analysis  process  proVKlcw 
the  licsl  mclhmi  ol  insiinni’  dial  all  lasks  .iic  covcicvl  and  that  elleclive  ptocciliires  arc  devcloivd  See 
lovee  fl  til  I l‘>7  v.i.  I'i74b.  A ri7kl  tor  tccomiiieiulcd  task  analysis  proccdiiics 

2 Ihc  coiili.icloi  shoiihl  have  complete  and  timely  access  to  the  ei|iiipmeiit  diiritij;  the  ctilical 
sl.iitcsol  data  ilevelopment 

V \ thoioiipji  "hands  on"  vet llic.it ion  ol  the  |ob  itiiide  and  MIS  I'loccvliires  should  Iv 
acconiphshevl  (hilv  the  veiy  diHiciili  and  Iciicthy  tasks,  aiiil  Ihc  very  simple  l.isks.  shoiiUl  Iv  exvliided  Ihc 
1 1 I \ piovcdiiies  should  1h'  vciilied  lo  the  maxniniin  cxieni  I'ossible. 

4 ( onsidciation  should  be  itiven  lo  use  ol  the  dii.iMevel  appioach  Ihe  dii.il  level  ai'pro.ivh  van 

coniribnie  si[tnilicanlly  to  acceptance  ol  Ihe  vlala  by  ex|X'iienceil  lechmci.nis  Ihc  vlii.il  level  tcalurc  also 
illows  a lechnician  lo  "prow  with  the  syslenr  as  he  pants  exi'crience.  in  that  he  can  I'ropress  liom  the 
iletailed  to  the  peneral  itiloinialion  level 

“v  Hie  )ob  puides  slioiild  be  printed  on  very  durable  p.ipei  Al  least  the  hiph  use  |ob  pindes  should 
be  I'rmled  on  pa|>ei  that  is  ini|iei\ions  lo  oil  and  walci  and  will  nol  easily  leai  out  ol  the  bnidei  Hie 
aildilional  cost  should  he  more  lhaii  compensaled  lot  by  savinps  resnll'iip  lioni not  liavinp  lo  repl.ivc  |ob 
pnide  manuals  which  have  missnip  papes. 

().  An  nnpioved  bnidei  should  be  devclo|K'd  ot  adopted  lot  use  with  Ihe  |ob  puides  Ihe  bnidei 
should  have  a haid  back  lor  easy  stoiape  and  should  have  a means  ol  sc'cunnp  papes  which  teduces  the  risk 
ol  papes  beinp  lorn  out 

7.  I enplhy  checkoul  procedures  slu>iild  be  avoided  l or  an  exislinp  weapons  system,  the  exislinp 
checkout  procediiies  sliould  be  careliilly  checked  and  iildi/ed  il  they  are  satislaclory  l ot  new  weai'on 
sysicnis.  Ihe  checkoul  tHocediites  should  be  dcsipned  to  lie  as  short  as  possible  while  providinp  an  adev|ualc 
check  ol  the  system.  Ihe  orderly  nature  ol  procedurali/ed  insiructions  appaienlly  encouiapes  wnlets  lo 
increase  the  Icnpth  ol  checkouts,  lengthy  procedures,  however,  lend  lo  discourage  the  iisei  and  may 
encoiitape  inattenliveness  and  errors. 

X.  ( are  should  be  taken  to  insure  that  only  one  JCiM  is  iei]Uired  lor  one  |ob.  Hie  prou|itnp  ol  |ob 
puides  into  JCiMs  should  be  such  that  the  procedures  lor  related  tasks  (e.g..  lollow-on  tasks)  are  liKaied  in 
Ihe  same  manual  whenever  possible.  Hie  reiiiiireineni  lor  taking  more  lhan  one  manual  is  very  iinlalinp  lo 
the  Icchniciati 
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A good,  comprelicnsivc  unplenientation  plan  should  be  developed  well  in  advance  ol  actual 
iinplcnientation  ol  the  data  A well  thouglil  out.  long  range  plan  is  necessary  if  major  prohlenis  arc  to  be 
avoided  when  job  guides  arc  introduced.  Tliis  is  especially  true  if  the  job  guides  arc  replacing  conventional 
TOs  lor  an  existing  systeni,  Tlic  plan  should  provide  guidance  for  the  program  in  such  areas  as  informing 
the  bases,  making  decisions  about  utili/ation  policy,  providing  for  training,  and  encouraging  ulili/.atiori. 
Hiis  plan  should  then  be  used  by  the  bxse  project  monitors  to  develop  specific  plans  for  implemailalion  at 
each  base.  See  Ap(rcndix  C for  guidance  in  developing  implementation  plans. 

10.  \ short,  effective  t aining  program  sliould  be  developed  and  administered  to  all  ii.sers  prior  to 
implehientation  ol  tlie  data,  llie  program  should  include  instruction  on  the  purpose  and  advantages  of  the 
new  data,  contents  ol  each  type  of  manual  included  in  the  system  (KiM.  l.TIA,  (jAM,  MSIM  and  WD). 
how  to  use  the  index,  how  to  use  the  job  guides,  how  to  use  the  LIT As,  and  policies  for  use  of  the  data 
1 xerases  should  lie  provided  to  give  the  technicians  practice  in  locating  rerjuired  materials. 

11.  A special  system  should  be  provided  for  identifying  and  correcting  errors  during  the  first  few 
months  after  implementation.  A special  program  should  be  established  between  the  bases,  the  command 
headquarters,  the  appropriate  .Air  Ixigistics  (.'enter  and  the  contractor  which  will  jicrmit  sfieedy  handling  of 
the  A1  lO  I'onn  22s  that  document  necessaiy  changes  to  K)s.  Under  normal  circumstances  this  is  a long 
and  cumbersome  process.  Hie  users  should  be  encouraged  to  identify  and  report  errors  in  tlic  data. 

12.  A strong  emphasis  sliould  be  placed  on  using  the  data.  It  is  important  that  the  users  be 
encouraged  to  actually  use  the  new  data.  Hiis  is  especially  true  when  job  guides  are  replacing  conventional 
Kh  on  an  existing  weajion  system.  In  tliis  situation  there  is  generally  a large  group  of  exjicrienced 
technicians  available  who  prefer  not  to  use  any  kind  of  TO.  llie  transition  to  procedurali/.ed  data  seems  to 
be  particularly  difficult  for  these  technicians.  IX-finite  utili/ation  procedures  and  requirements  are  needed 
so  that  all  know  what  is  exjx-'cted  of  them.  Supervisors  should  encourage  the  use  of  tlie  new  TO  and  should 
insure  compliance  with  local,  command,  and  Air  lorce  usage  policies.  Ixrcal  and  command  insjx’ctors 
sliould  be  very  tamiliar  with  usage  requirements  in  order  that  they  might  properly  encourage  and  require 
TO  utilization. 
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/V.  part  <>l  a pio|Oi.l  to  improve  Air  l oree  Tceliniea)  Orders,  a survey  is  bciiij:  made  by  the  Air  Torce 
Human  Resouiees  lalxirators  to  identity  llie  strengtlis  and  weaknesses  of  existing  TOs  and  proposed  new 
tyjK-s  ol  TOs.  ^'onr  experience  witli  tlie  present  K)  system  can  provide  valuable^  information  on  its 
strengths  and  weaknesses  and  ean  provide  a basis  tor  recommendations  for  future  ihodifications  to  the 
SNStein.  Ilie  tollowing  ipiestions  liave  been  prepared  to  obtain  intdrmation  on  how  you  use  lOs  and  how 
you  would  like  to  see  them  eliaiiged,  Itease  be  t rank  and  lionesi  in  expressing  your  opinions 

llie  information  llial  m u provide  will  be  ii.sed  lot  researeli  purposes  only.  No  attempt  will  be  made 
to  identify  individuals  I lie  results  will  be  reported  in  summary  lorm  only. 

New  ( -141  Technical  Data 

Tlic  .\ir  1 oice  has  purchased  a new-  tyix-  of  lechnical  data  tor  the  t'  |41  A on  equipmenl  nuiintenancc. 
Tins  new  data  will  be  tested  at  this  base  soon. 

Two  types  of  instructions  arc  provided  with  the  new  data  Tliey  are  job  guide  manuals  (JtiMl  and 
logic  tree  troubleshooting  aids  (I  ITAl.  nie  Jt.Ms  provide  step-by-step  instructions  for  all  on-eiiuipmcnt 
niamteriancc  of  the  ( -14IA.  Hie  insiriictions  are  keyed  to  detailed  illustrations  to  help  you  locate  the 
components  referred  to  in  the  instructions.  All  of  the  information  required  to  complete  the  )ob  is  included 
in  the  J(iM.  Sample  pages  Iroin  a JtiM  are  shown  on  the  lollowing  (>agc 

ITTAs  provide  a troubleshooting  strategy  and  step-by-step  instructions  for  all  on-equipmeni 
troubleshooting  tasks.  Pie  instructions  are  presented  in  a lorinat  similar  to  that  used  in  ttic  KiMsandarc 
supported  by  illustrations.  Pie  inslnictions  spccily  the  sequence  ol  checks  to  be  used,  expected  result  at 
each  check,  and  prescribe  tbe  proper  corrective  action 

Please  examine  the  sample  job  guide  manual  on  the  lollowing  page  and  answer  the  iiuestions 
beginning  on  page  I 1 . 


S‘) 


T O 1C-141A-2-4JG-4 


TO  1C-141A-2-4JG-4 

REMOVE  AND  INSTALL  FUEL  CONTROL 
UNIT 

INSTALL  FUEL  CONTROL  UNIT: 

lnsp*<t  Engine  Gearbox  Oil  Seal 
and  Spline : 

1.  InsDect  fuel  control  drive 
oil  seal  (2)  for  evidence  of 
oil  leakage.  If  leakage  is 
evident,  replace  oil  seal  (2) 
per  T.O.  1C-141A-2-4JG-3 . 

2.  Clean  gearbox  spline  (1) 
with  wire  brush  and  solvent, 
P-D-680  to  remove  dirt,  grit 
and  old  lubricant. 

3.  Inspect  internal  splines 
(1)  for  overall  condition.  If 
splines  are  broken,  chipped,  or 
cracked  and  engine  change  or 
gearbox  (ADH)  change  will  be 
reguired . 

4.  Remove  (blend)  any  small 
nicks  or  dents  in  splines  with 
a honing  stone  or  small  file. 

5.  Remove  all  traces  of 
corrosion  (red  oxide)  from 
spline  with  wire  brush. 

NOTE 

In-process  inspection  of 
steps  1 thru  5 is  required 
prior  to  performing  step  6. 
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I.  Have  you  ever  used  job  guide  manuals  or  logic  tree  troubleshooting  aids  similar  to  those  described 
above’ 

I Yes 

No 


2.  Do  you  think  that  the  new  job  guide  manuals  and  troubleshooting  aids  will  help  you  do  your  job'’ 

I Better 

2.  About  the  sann; 

-V  Not  as  well 

2.  Do  you  like  having  detailed  step-by-step  instructions  such  as  those  found  in  the  job  guide  manuals'’ 
I.  Yes 

2.  Makes  no  difference 

3.  No 

4.  IX)  you  like  having  detailed  illustrations  keyed  to  the  step-by-step  procedures'’ 

I , Yes 

2.  Makes  no  difference 

3,  No 

5.  W3iich  tyjx'  ot  technical  data  would  you  prefer  to  use'’ 

I or  routine  jobs 

I . I raditional  TO 

2.  Checklist 

3,  Job  (luide  Manuals 

4.  Very  general  procedures 

for  non-routine  jobs 

I.  Traditional  TO 

2.  (3icckhst 

3.  Job  (luide  Manual 

4.  Very  general  instructions 

().  If  you  were  required  to  use  job  guide  manuals  for  every  job,  what  would  be  your  attitude'’ 

I . leased 

2.  Mostly  pleased 

3.  Somewhat  irritated 

4 Irntated 

7,  If  you  were  experienced  on  another  aircraft  and  transferred  to  work  on  the  C-I4I,  wliich  of  the 
lollowmg  would  be  the  most  helpful  to  you  in  becoming  qualified  on  the  C-141'’ 

I.  A I ( school 

2.  l IDschiMil 

3.  OJ  I 

4,  Job  (luide  Manuals  and  Ixigic  Tree  Troubleshooting  Aids 

5.  Conventional  TO 
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Which  of  the  following  do  you  believe  would  be  tlie  most  likely  to  improve  the  efficiency  of 
maintenance  operations? 

I More  AT(' training 

2.  Better  ATC  training 

-V  Better  conventional  T()s 

4 Job  Mifju  ah  and  logic  Tree  Troubleshooting  Aids 
5.  More  qualified  personnel 

P.  Better  supply  support 


im  \l)l\  H JOB  C.LIIDt  OUBSTIONNAIRI. 


lilts  survey,  prepared  In  llie  \ii  l inee  llimiati  Kesinirces  l aboratory  is  a part  of  the  Study  of  User 
Aseeptanee  and  Usability  ot  the  ( -141  Job  (iiiides.  Hie  data  will  be  used  to  imprme  future  Job  (lUidc 
Manual  purehases  tor  new  aiieralt 

llease  write  your  rank.  Al  SC,  and  Squadron  in  the  spaces  provided  below  Your  name  is  not 
reqitiied,  Ansvvei  the  questions  as  honestly  as  possible.  You  may  wiite  additional  comments  if  you  wish  to 
do  so,  Kemembei,  your  oinnions  will  liel[>  improve  future  technical  orders. 


RANK _ Al  S(  _ _ SOI  \l)RON AMS I MS OMS  

There  are  no  iijdii  oi  wroiip  answers.  Ilease  indicate  your  most  preferred  answer  (one)  by  circlinp  or 
checkinp  the  appropriate  letter. 


PRIVA(  Y A(  TION  STA  TI  MKNT 


Al  IIIORII't  l(’  use  H0I2,  Secretary  ol  the  Air  T'orce,  Powers.  Duties.  IX'lepation  bv 

Conn'sensation. 

PRIN(  IP\1  PI  RPOSI  To  determine  the  opinions  of  tlie  users  concerninp  the  usability  and  acceptance  of 
the  C 141  Joh  Uuirle  Technical  Orders. 

ROt  I INI  P(  RPOSI  Results  will  be  tabulated  for  reportinp  purposes. 

DISC  I OSl'RI  Disclosure  is  voluntary.  However,  your  answers  will  help  the  Air  l orce  tmprove 

the  luluie  technical  orders.  Your  cooperation  is  preatly  appreciated 


Tilts  survey  has  been  approved  by  the  Military  Personnel  Cenlet. 
Randolph  APB.  Texas 
USAf-  SCN-7(vl5() 
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1 Mow  do  you  tike  the  Job  (tuidc  Manuals’ 

a.  Idiey  arc  completely  satisfactory. 

h Tlicy  ate  good,  hut  could  be  improved. 

c.  Uiey  are  satislactory.  but  no  belter  than  the  old  TOs. 

d.  Micy  arc  unsatisfactory  . 

; Tilt  si/e  of  the  Job  (luide  Manual  is 

a.  Too  small.  . 

b.  T(ki  big. 

c.  Okay 

d.  Just  rigtii 

.V  TTie  illustrations  arc 

a.  1 xccllent. 

b.  Poor. 

c.  Okay. 

4 Do  the  job  guide  proccdiirc's  contain  all  the  information  you  need  to  do  the  job  ’ 

a.  Yes,  for  all  jobs. 

b.  Yes,  for  most  jobs. 

c.  Some  information  is  missing  for  some  job  guides,  but  guides  arc  still  usclul. 

d.  Missing  information  miJscs  job  guides  unusable. 


5.  Arc  the  procedures  correct’’ 

a.  Almost  always. 

h.  Mostly. 

c.  Seldom. 

d.  Never. 

6.  l>i  you  have  any  difficulty  in  understanding  the  procedures’’ 

a.  Always. 

b.  Mostly. 

c.  (Jccassionally. 

d.  Never. 

7.  Arc  too  many  books  required  to  do  one  Job’.’ 

a.  Always. 

b.  Mostly. 

c.  (Kcasionally. 

d.  Never. 

K I>)  you  find  the  procedures  in  the  job  guides  to  be  twi  simple  ( tcxi  detailed)’’ 

a.  Yes,  for  most  jobs. 

b Yes,  for  some  jobs. 

c.  No,  about  nghi  for  most  jobs. 

9.  I>)  you  use  the  dual-level  feature’’ 

a.  Mostly. 

b.  Seldom. 

c.  What  is  the  dual-level  feature’’ 
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10.  Hjvc  ytni  had  any  problenis  with  lost,  torn,  .u  dirty  I ()  pages’ 

a N cs.  a hit 

h Some. 

c \'ei>  little 

d So. 

1 I l)o  you  Use  the  procedure  headings  as  a checklist  ’ 

a I leipiently. 

b Sometiines. 

c.  Sever, 

I r.  Would  you  p'-.'lei  to  use 

a.  Traditional-style  I()s. 

b Job  ‘ luide-sty  le  lOs 

c.  Checklists 

d.  So  lOs 

I J.  What  do  you  think  is  the  best  leature  of  the  lob  (iiiides’ 

a.  Si/e 

b Siinphcity. 

c.  Step  by -step  procedures. 

d.  Illustrations. 

e.  IJiial  level  ol  irislriiclioiis. 

t.  Other 

14  Many  ol  the  illustrations  are  printed  on  lohl-out  ('ages  IXies  this  make  the  illustrations 

a.  \'ery  convenient  to  use. 

b So  j'loblem  to  iisiv 

c.  iJiH'icult  to  use. 

1^.  Ihe  ilhistiations  are 

^ a.  Secessary  to  complete  most  |obs 

b llelj  till  for  most  jobs 

c.  Ilelplul  but  usually  not  necessary. 

d.  Sot  needed  lor  any  job. 

Ib  An  index  ls  provideil  '.o  help  you  locale  inlormatioii  m the  job  guide  manual.  Hie  index  is 

a.  Very  helptul.  I’erinits  ra|>id  location  of  all  job  guide  intormation. 

b.  Usually  hclplul  Aids  in  locating  most  re(|utred  job  guide  inlormation. 

17  riie  (.AM  provides  general  mrorniation  on  the  A(  and  its  systems  How  uselul  is  this  matiuar’ 

a.  Very  irseltil.  I 'sed  lre(|iiently . 

b.  Somewhat  uselul.  I ked  occasionally 

c.  .Seldom  uselul.  Karely  used. 

d.  Have  (lever  ii.sed  It 

IK.  (Vs  a source  ol  iiilormatior:  lor  your  |ob,  Ihe  new  job  guide  manuals  are 

a.  Much  better  than  Ihe  old  KK 

b.  Keller  than  Ihe  old  lOs,  but  can  be  improved.  Reriiiire  rennemerU. 

t.  So  lief  ter  than  Ihe  old  T Os 

d.  Worse  than  Ihe  old  HK 


65 


a 


I 


I 

I 

I 

I 

I 


I 

f 

,i 

♦ 

i 

I 


1 4 One  of  the  pools  of  the  K>  program  is  to  provide  better  tech  data  to  encoiiiage  use  on  the  job  Do  > on 
tcel  that 

a.  'i  ou  use  JfiMs  mote  than  the  KK 

b.  About  the  same  as  the  old  TOs 

c.  less  than  the  old  TOs. 

20  Hois  Valuable  do  you  think  the  Job  (iiiides  are  to  Oi  l I 

a.  Valuable  imich  better  than  the  old  TOs 

h.  Valuable  about  the  same  as  the  old  TOs 

_ c".  Ot  little  value  about  the  same  as  the  old  lOs 

d.  Of  no  value  much  worse  than  the  old  HK. 

21  If  you  are  an  OJ T trainer,  how  valuable  are  the  Job  (iiiulesin  helping  someone  learn  the  aircralf' 

a.  Very  valuable  much  bet tei  than  the  old  lOs 

b Valuable  about  the  same  as  the  TOs. 

c.  Of  little  value  about  the  same  as  the  old  K)s 

d.  Of  no  value  much  worse  than  the  old  lOs 

22.  Are  less  exiieriericed  technicians  doing  more  work  on  the  aircraft  because  ol  detailed  (irocedures  in 
the  Job  (lUides’’ 

a.  'res 

b.  No 

2.T  Nkould  you  recommend  that  job  guide  manuals  be  purchased  loi  use  in  your  simp' 

a Yes.  lor  all  tasks 

b.  'l  es.  lot  some  tasks. 

^ c.  No. 

24  Would  you  recommend  that  logic  tree  troubleshooting  aids  be  purchased  foi  use  in  voui  shop  ’ 

a.  ^’es.  (or  all  tasks. 

h.  '•'cs.  lor  some  tasks. 

c.  No. 

25.  Do  you  tfiink  that  the  new  job  guide  manuals  and  Iroublesliooling  aids  w ill  helj'  vou  do  youi  job  ’ 

a.  Belter 

b.  .About  the  same. 

c.  Not  as  well. 

26  Do  you  like  having  detailed  slep-by-sicp  instructions  such  as  those  lound  in  the  job  guide  manuals  ’ 
a.  Yes 

b.  Makes  no  difference. 

c.  No. 

27.  Do  you  like  having  detailed  illiistiaiions  keyed  to  the  step-by-step  procediiies  ’ 

a.  Yes. 

b.  Makes  no  difference. 

c.  No. 
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Whuii  l>iH‘  ot  Icchnical  data  would  you  prefer  to  use'' 

1 or  routine  jobs 

a Iradilion.ll  I() 

h ( heeklisl. 

e lob  ( lUide  Manuals 

d Vets  general  procedures. 

l or  non-rout  me  jobs 

a liaditional  TO 

b Cbcvklist 

c.  Job  ( ■uidc  Manual 

d \'er>  jteneral  instructions 

JO  How  do  sou  leel  about  beinj;  rei|uired  to  use  job  guide  manuals  lor  every  job'’ 
a llcased 

b MosiK  jrleased 

Soinew'lial  irritated. 

d Irritated 

H It  soil  were  exix'rienatd  on  another  aircraft  and  transferred  to  work  on  the  C l 4 1 , wtiich  of  the 
lollowing  would  be  the  most  helpful  to  you  in  becoming  qualified  on  the  C-I4r’ 
a AICschiKil 

_ b I ID  school 

OJ  1 

_ _ d Job  (iiiide  Manuals  and  logic  Tree  Troublesliooting  ,-\ids. 

e ( onveiiliorial  ID 

Vk'.  h ot  the  tollowmg  do  you  believe  would  be  the  most  likely  to  improve  the  efficiency  of 
nainie  nance  ojie  rat  urns'’ 
a More  -MC  naming 

t’  Hcitei  M(  training. 

IV-tiei  conventional  KK 

d Job  (lUidc  Manuals  and  Uigic  Itee  I roublesluxiliiig /\ids 

(•  More  qualified  jH-rsoniiel 

I IVlter  supjily  support 

I roubk-shooiing 


It  you  have  used  logic  Itee  I roiibleshooling  Aids  ( LIT  As),  please  answer  Uie  lollowing  four  questions  If 
you  have  not  used  I I I As.  please  complete  the  questionnaire  by  answering  question  w.J7. 

.VJ  logic  tree  troubleshooting  aids  (I  If  As)  sjx’cify  the  troubleshooting  strategy  and  provide 
step4iy-itep  instructions  tor  isolating  faults. 

Do  you  prefer  to 

a.  Use  I TT  As  lot  all  troubleshooting  tas)«. 

b.  Use  I n As  for  infrequent  troublesliooting  taslcs  only . 

c.  Use  1 TT  As  for  the  most  difficult  troiibleshixiting  tasks  only . 

d.  Develop  own  troubleshiHiting  strategy  and  not  use  LIT  As  at  all. 


XI. 
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.^4.  Mow  do  you  feci  about  being  required  to  use  l.H  As  lot  all  troublesliootmg  jobs'' 

a.  Heased 

b Mostly  pleased. 

c.  Somewhat  Irritated 

d.  Irritated. 

Do  the  LTTAs  lead  to  correct  isolation  of  the  problem'’ 

a.  Yes,  always. 

b.  Lisually. 

c.  Sometimes. 

d.  Seldom 

IX>  LTTAs  require  more  or  less  time  to  troubleshoot  a problem'’ 

a.  Less  time  is  required  using  LTTAs. 

b.  About  the  same  amount  of  time. 

c.  More  time  is  required  when  using  l.TTSs. 

37.  If  you  could  influence  the  purchase  of  job  guide  tyjK’  manuals  for  a new  aircraft,  what  changes  would 
you  tecomuK'nd'’ 
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•1/7V  \7)/V  (•  ('.liinANCl  1 OR  IHl  IM  VHORMl  Ni  ()l  IMIM  1M1N1  Al  lON  IM  ANS 


SucccsstuI  impicmenlalioii  must  he  planned  well  in  advance  ol  the  actual  start  date,  and  it  should 
involve  the  users  as  much  as  posskble.  Ideally,  a Project  OtTicer  will  have  been  selected  Irom  the  major  using 
command  before  the  technical  data  c\>ntract  is  awarded.  Ilie  command  project  officer  (CP())  is  very 
imjiortant  to  the  success  of  the  contract  and  the  following  implementation  Me  should  be  selected  with 
;.are.  If  jiossible.  the  project  officer  should  be  of  sufficient  grade  or  have  sufficient  backing  to  "make  things 
hapjxm  " Mic  attention  of  and  accesibility  to  a higlier  grade  officer  who  can  take  the  responsibility  for 
making  decisions  tor  the  ('ominand  is  also  vilal. 

llie  project  monitors  for  each  ba.se  should  be  selected  early  in  the  data  development  |)lia.se.  Tlie 
monitors  should  help  select  users  to  participate  in  the  in-process  reviews  (IPRs).  Rase  monitors  should 
participate  in  as  many  meetings,  conferences,  and  in-process  reviews  as  possible  to  familiari/e  themselves 
with  the  data. 

Mie  Command  Project  Officer  (CIA))  and  the  base  project  monitors  should  meet  to  develop  the 
comnund  and  base  level  imi'lementation  plans.  The  following  topics  should  be  included  in  the  plans 

I I raining  or  orientation. 

1 Ikjtes  ol  implementation. 

1 leadrjuarters  assistance. 

4 Policy  for  using  new  TOs. 

“i  Removal  ol  old  lOs. 

b.  Informing  all  lO  users  ( Supply  . I'  ll),  etc.) 

7 Adequate  supplies  of  new  lOs 

H.  Distribution  of  new  K)s. 

Storage  of  I Os  in  sliojts.  trucks,  and  airplanes. 

10  I rror  reporting, 

II.  I 'pdate  procedures. 

I 2 Rase  level  briefings  and  Progress  Reviews 
I f Idllow  up  reviews  and  inspect  ions. 

S[x;cilic  gmdelmes  lor  each  ol  the  above  are  discussed  in  the  lollowing  paragrajihs. 

I Iruinm^  or  < )mniuiio>i  An  effective  training  or  orientation  program  Ls  necessary  to  prevent 
coiilusion,  dissatislaclion  and  failure  to  use  the  new  lOs.  While  it  is  true  that  the  job  guide  concept  is 
relatively  simple  to  understand  and  use.  training  is  needed  to  insure  that  the  users  understand  the  purjwse 
ot  the  data,  the  contents  ol  the  data,  and  how  to  use  them  A training  program  oldniy  4 hours  duration 
can  increase  the  utili/atiori  and  acceptance  of  the  data  by  making  the  users  more  lamfliar  with  the  contents. 
Ttie  course  should  Ix'  developed  by  using  coimnand  headquarters  training  jx;rsoimel  who  are  very 
knowledgeable  about  the  contents  and  proper  use  of  the  books.  Such  topics  as  how  to  find  information; 
how  the  data  sliould  lx  used,  the  kind  ol  information  that  tlie  job  guides  do  and  do  not  contain;  contents 
and  purpose  ol  the  MSIM.  (.AM.  I Tl  A.  and  Wl)  volumes;  care  and  storage  of  the  books,  how  to  report 
errors,  and  how  to  update  should  be  covered  m the  training.  As  much  as  is  feasible,  the  training  should 
require  the  students  to  participate  by  completing  exercises  to  insure  familiarity  with  the  new  data.  The 
exercise  should  require  the  trainee  to  actually  locate  and  review  sjx’cific  information.  Hie  training  should 
be  given  at  wing  oi  stjiiadion  level  by  local  Irainmg  personnel  All  maintenance  jiersonnel,  including  officers 
and  senior  N(  (K  should  attend  the  training  I he  training  will  be  the  first  opportunity  for  most  of  the 
[xople  to  see  the  new  I (K.  so  it  sliould  be  positive  in  nature.  'Die  class  should  be  completed  prior  to,  but 
not  more  than  one  month  helore  implementation. 

2.  Ikjii’%  nie  actual  dates  of  implementation  should  he  selected  to  avoid  conflict  with  other 
known  extraordinary  events  at  the  bases,  such  as  inspections,  exercises,  heavy  TDY  requirements,  weapon 
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s\.steni  changes,  etc.  /Ml  ol  the  TOs  should  actually  be  available  at  each  base,  and  ready  tor  distribution  at 
least  two  days  prior  to  the  first  day  of  iinpleinentation  /Ml  necessary  storage  lacilities  for  the  TOs  in  the 
shops,  trucks,  or  aircraft  should  be  ready  by  the  impleincntalion  date 

.V  lli  oilquancn  Assistance  - Assistance  by  headquarters  personnel  should  play  an  iniiiortant  role  in 
the  iniplcinentation.  In  addition  to  developing  the  coiiiinand  policies  on  using  llie  T()s.  the  (Tf)  should 
indicate  and  monitor  the  development  of  the  training  or  orientalion  program  by  the  headquarters  training 
section  Tlie  (T’O  and  his  team  should  also  astsist  the  bases  in  selecting  the  base  level  protect  monitors  and 
technicians  for  IPRs  and  verification  efforts  Headquarters  assistance  can  also  be  given  by  presenting  the 
initial  briefing  to  tlie  IX-puty  Commander  (or  Mamtenana’  (OCM)  and  his  stall  on  the  new  !(>;,  During 
implementation,  the  CPO  and  his  team  should  be  available  to  assist  in  answering  questions  and  encouraging 
proper  use.  Hus  may  require  that  implementation  occur  sequentially  at  the  bases,  rather  tlian 
simultaneously.  It  simultaneous  implementation  is  desired,  some  way  should  lx-  found  to  have  at  least  one 
knowledgeable  headquarters  representative  at  each  base.  This  represcritativc  sliould  wiirk  with  the  base 
project  rnonitor  to  insure  that  personnel  are  knowledgeable  and  prepared  for  the  fust  day  of 
implementation.  He  sliould  also  he  available  to  answer  questions,  monitor  projxu  usage  ol  the  TOs,  and 
assist  in  giving  progress  and  status  briefings  to  the  IX'M.  /\  follow-up  visit  to  the  hxal  bases  sliould  be  made 
approximately  ,^0  days  after  implementation.  Additional  visits  would  be  appropriate  if  problems  in  using 
the  TOs  ate  prevalent. 

4 1‘oliev  tor  I sini>  the  I'Os  - Tins  is  a very  important  topic  that  should  be  understood  by  both 
Headquarters  and  base  level  maintenano;  and  inspection  [xusonnel  Hie  policy  for  using  the  TOs  probably 
will  have  been  develojx'd  during  the  early  stages  of  the  data  procurement  process.  Certainly  the  policy 
should  be  (inali/ed  by  the  time  the  iinpleinentation  plan  us  develojx'd.  TTie  CIX)  sliould  insure  that  an 
approved  usage  policy  does  exist  and  that  maintenance,  inspection,  and  policy  management  personnel  at 
both  Headquarters  and  at  base  level  are  faimliar  with  it.  llius  is  especially  important  because  of  the 
step-by-step  procedutali/.ed  nature  of  the  data.  IXx's  the  experienced  maintenance  man  have  to  follow  cren’ 
detailed  step  ’ Is  it  sulficient  to  review  the  procedure,  then  do  the  job  by  memory'’  Do  some  jobs  require 
the  user  to  follow  every  step,  every  time,  exjx’rience  and  qualifications  not  withstanding'’  Do  the  Quality 
Control  and  Headquarters  inspectors  have  the  same  understanding  of  u.sagc  rei|iiirements  as  the  techniaans 
and  sujx'rvisors  do'’  Ihesc  and  other  questions  should  be  an.swcred  by  the  command's  policy  for  TO  use. 
This  policy  mast  be  understood  and  generally  accepted  by  base  level  personnel. 

5 Kemovat  of  the  (>U  TOs  -Tire  old  TOs  which  arc  being  replaced  by  the  new  job  guides  should  be 
removed  Irom  all  shops,  trucks,  and  aircraft  on  the  morning  ol  the  first  day  ot  implementation.  It  the  old 
IDs  are  kept  in  place,  the  new  I Os  will  get  very  little  use,  the  transition  will  be  more  dil  ficult  and  longer, 
and  the  acceptance  ol  tbe  new  KX  by  the  user  is  likely  to  be  less.  Wien  in  doubt  or  in  a hurry . jx-ople  will 
generally  turn  to  wliatcver  they  are  nxire  familiar  with  Tins  would  be  the  old  TO.  The  best  solution  is  to 
make  the  old  TOs  unavailable  for  use  at  the  same  time  the  new  ones  are  to  be  implemctited. 

6 Informinf!  all  I 'sers  All  of  the  organi/'ations  who  have  ixcasion  to  use  KX,  such  as  the  field 
Training  iVtachment  (f  TD),  Material  Control,  and  Ha.se  Supply  sluv.’ld  be  made  aware  of  die  upcoming 
change  in  TOs  and  sliould  be  given  an  opportunity  to  become  familiar  with  the  new  system  in  advance. 

7 Adeqmte  SuTphes  of  .Vex  TOs  Hie  ( K)  should  receive  rejioits  from  the  ba.se  project  monitors 
as  to  the  completeness  ot  the  lO  inventory  at  each  base  I Ins  is  to  insure  that  each  base  drx's.  in  tact,  have 
sufficnent  copies  ol  each  requited  voluiix  to  petiiut  complete  coverage  ol  the  required  iiuirilenatice.  If 
possible,  the  new  f(X  sliould  be  distributed  at  least  two  lull  working  davs  piioi  to  inijilemeiilalion.  Iliis 
will  allow  each  technician  an  opportunity  to  review  tlie  bixiks  and  recall  the  orientation  class  jinor  to 
actually  using  the  data 

8 IHsirihutuin  of  the  ,Vi’h  T(fs  iTie  Ct’O  and  the  base  I’rojeci  Monitor  should  determine  how  the 
new  rOs  will  be  distributed  Will  dislribiition  be  by  individual  or  by  shop'’  How  many  copies  should  each 
shop  get'’  Will  |l)s  be  placed  in  the  tliglit  line  trucks  and/oi  aircratl  as  well  as  the  sliojis'’  Is  the  dLstribution 
policy  consistent  with  the  usage  policy'’ 
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'*  Sh'rjKt  i>l  >lh  \<  H T(h  One  of  the  ty|iical  characteristics  of  job  guidc-ty|>e  T()s  is  tlieir  small 
si/e  Hiis  small  si/e  results  m more  volumes  Also,  the  binders  that  the  job  guides  arc  stored  m usually  have 
solt  covets  and  consei|uenll\  aie  dillicull  to  stand  alone  on  a shelf.  Tlicse  facts  may  necessitate  new  storage 
facilities  in  the  stiop,  the  trucks  and  the  aircraft  Itie  small,  soft  binders  will  generally  require 
mdmduali/cd  compartments  it  they  are  to  be  aitanged  neatly  (ireater  amounts  of  storage  space  will  also  be 
required  wherever  the  lOs  are  stored 

It)  I rrer  l\ci>,'rnin:  Ihe  ik-w  KK  are  cerlain  to  have  errors  in  tliem  which  escaped  detection 

diinng  vciitication.  Ihe  vers  detailed  proceduiah/ed  nature  oj  job  guides  make  errors  very  noticeable  to  the 
users  I HOIS  also  decicasi'  ihc  conlidence  the  user  has  in  tlie  data,  and  tend  to  discourage  utili/.ation. 
I’loiedures  sbouhl  be  esiablished  by  the  ( I’O  and  the  base  project  monitor  to  provide  for  efficient 
identilication  aiul  lej'orting  ol  eirors  It  jiossible.  the  routing  of  AIK)  l orm  22s  from  itie  user  to  Quality 
( ontrol  to  I leadquartcis  should  be  sjK'eded  uj>.  Headquarters,  in  turn,  should  insure  that  mininuun  delay  is 
encountei.  d Ivlwcen  the  heailijuarlers,  ihe  apj'ropriate  Air  I ogislics  ('enter  ( Al.C),  the  contractor  and  the 
publkation  ot  revisions  I’lomjit  ideiititication  and  correction  of  errors  wBI  improve  maintenance 
procedures,  mcre.tse  user  acceptance,  and  increase  uiih/.ation  of  TOs. 

rr~~  ' ihiu/inv  l‘n>i  citurcs  Ihe  many  j'agcs  ol  procedurali/ed  data  and  the  number  of  volumes  may 
necessitate  a change  rniqWSl^-jiUiii.du^  Ihe  (I’O  should  work  with  the  A1  ('  TO  manager  and  the  base 
level  lechnical  Older  Disliibulion  r 110!*^'  IH^ Man j t ,i,.i..rf'm..  cvjiat  the  update  requirements  will  be 
I’rocediiies  sliould  be  develoj'ed  to  insure  thal  efficient  TO  ufiitrttHf  " ilLoccur. 

12  /Aivi  level  Hritlinvuihl  I’maress  Heviews  Initial  briefings  should  be  given  by  the  CPO  to  each 
l)(  \l  and  bus  stall  earlv  in  the  develojmienl  pha.se  Tlie  briefing  sliould  cover  the  tyjie  of  data  being 
I'lirchased.  the  dilteiences  between  the  new  and  old  TOs,  how  Ihe  data  will  be  used,  the  benefits  of  the  new 
ilala.  and  Ihe  aj'ptoximale  implemenlalion  dale.  Supjiort  requirements  from  each  base  should  be  identified, 
these  include  a base  level  I’rojcct  Monitor,  squadron  and  branch  level  monitors,  and  technicians  to 
I'arlicipale  in  Ihe  in-process  reviews  and  verification  proceedinjs.  Hie  I’rojcct  Monitor  should  keep  Ihe 
I K M and  his  stall  inlormed  about  the  development  of  the  data  and  Ihc  plans  for  implementing  them  It  is 
necevsarv  toi  Ihe  IK  M and  his  stall  to  be  supportive  of  and  knowledgeable  about  the  total  TO  program  if 
siiccfssliil  implementation  is  to  occur  Immediately  prior  to  implementation,  the  Project  Monitor  should 
insuri  thal  the  IX  M and  Ins  stall  fully  understand  the  program,  and  thal  they  do  and  will  full  support  Ihe 
imjilenientalion  During  iinjilemenlation,  the  ('I’D  and  the  Project  Monitor  should  keep  tlie  IX'M  and  his 
stall  inlormed  about  Ihe  status  ol  Ihe  program  and  any  problem  areas.  A briefing  at  the  end  of 
im|demenlation  sliould  identity  remaining  problem  areas,  and  should  provide  recommended  solutions. 

I 1 /0//0W  I />  A’lT/cw  s ami  In^pvTiion.s  Tlie  base  project  monitors  should  continue  to  monitor  the 

ulili/ation  of  the  data  and  identify  problem  areas.  Iliis  information  sliould  be  passed  on  to  tlie  CPO  and  the 
local  l)(  M and  his  stall  A follow-up  review  should  be  considered  by  Ihe  CK)  no  earlier  than  .10  days  after 
implemenlalion.  de[x.’nding  upon  tlic  progress  reported  by  Ihc  project  monitor.  If  jvissible,  amimand  and 
Air  force  ins|iection  teams  sliould  wail  at  least  two  months  after  implementation  before  inspecting 
maintenance  at  Ihc  base  Hus  should  give  base  officials  ample  time  to  smooth  out  any  necessary  changes  in 
maintenance  procedures  If  there  is  a shakedown  phase  at  one  or  two  bases,  insure  thal  the  project  monitors 
from  other  bases  are  observers. 

( oiiimand  Ilead(|uar1ers  PmjecI  Officer  Checklisl 

Ikila  Development  Phase 

Insure  that  base  mon'iors  art  named. 

I iiiah/e  usage  plans  (daily  use,  storage,  ujidatc,  etc.). 

Involve  users  (if  identifiable)  in  IPRs 

Hiief  IX'M  (preferably  at  his  base)  on  data  contents,  use,  benefits,  etc. 

Insist  ufKin  “lOO'v  hands-on  verification"  using  actual  users. 

IX'velop  base-lcvc  impleiiK'natation  jilan. 
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Prr  /mf)lfmcntatit>n  fhasf 

— Pieparc  oncntatiDti/trainiiH!  dass-studciil  worV.bt)i>k  type  haiidoiils 

— Insure  that  MO  people  responsible  lor  policy,  ii'S|X‘ctiori,  evaliialiin.  etc  are  in  agreement  with 
usage  plans,  evaluation  requirements,  etc. 

— Visit  each  base  to  insure  all  (training,  base  miplcmeritation  plan,  storage,  data)  is  ready  and  to 
brief  each  base  project  monitor,  (X  , and  IK  M on  their  responsibilities  duniig  implcmentatioii. 
Anange  special  “quick”  lUX  and  AIK’  handling ol  Al  TO  I'orm  22s. 

Dunnf!  Implementation 

— Insure  that  teams  are  present  at  each  base  to  assist,  answer  questions,  encourage,  etc 

— Iklp  base  project  monitor  identify  problems  and  determine  solution. 

— Work  with  base  project  monitor  and  IX'M  as  required. 

Monitor  usage. 

After  Implementation 

Monitor  status  and  progress  via  base  project  monitor. 

Insure  (with  Command  IKJ  support,  if  necessary)  that  IX  M is  involved,  committed, 
knowledgeable. 

Make  follow  up  visit  30  days  after  implementation  week  to  determine  status,  progress,  icsage. 

— Review  reports  of  first  inspection/evaluation  to  determine  if  problem  exists. 

Base  Project  Monitor  Checklist 

Data  Development  lliase 

Become  familiar  with  ttie  data  being  developed. 

— Attend  IPRs.  conferences,  etc. 

Help  select  qualified  representatives  to  participate  in  IPRs.  verification,  etc. 

— Help  briel  IX'V,  officers  and  key  NCOs. 

— Assist  Command  M(3s  Project  Officer  prepare  Command  level  implementation  plan. 

— Consider  special  problems  such  as  storage  facilities,  locations,  use. 

— Identify  Squadron-level  project  monitors. 

— Become  tamiliar  with  Command  Implementation  Han. 

Develop  specific  base  level  Implementation  Han. 

1‘re-lmplementation  I'hase 

— Insure  tfiat  Stalf  and  Squadron  Training  Agencies  are  ready  to  teach  the  Orientation  and  I raining 
class. 

— Review  the  schedules  for  each  squadron  to  train  all  of  their  maintenance  people. 

— Insure  that  the  IX  M,  Chiality  Control,  officers,  arid  key  NCOs  fully  understand  wluit  the  new  data 
are  and  are  not,  and  how  the  data  are  to  be  used  by  the  technicians. 

— Review  storage  locations,  distribution  and  update  plans,  and  AI  TO  Form  22  haiuUmg  procedures 

— Review  Implementation  Plan  with  DCM  and  staff,  key  officers  and  NCOs,  Quality  ( oiittol 
inspectors,  training  agencies,  and  squadron  project  monitors. 

During  Implementation 

— Insure  that  all  old  lOs  are  picked  up  at  the  start  of  the  first  day  of  implementation. 

— Monitor  usage  of  TOs,  using  Quality  Control  inspectors,  squadron  project  monitors,  and 
Corrimand  IK3s  team. 

— Work  with  users  to  identify  problems  and  determine  solutions. 

— Keep  IX'M  informed  of  usage,  progress,  status,  and  problems. 

— Assist  supervisors,  shop  chiefs,  users,  etc.  by  answering  questions  and  solving  problems. 

After  Implementation  Phase 

— Continue  to  iiKinilor  data  usage,  problem,  etc. 

— Keep  IX'M  and  Command  Project  (Xficer  infomied. 


AITIMVX  n 1 ISTIN(;  OF  AF  SCs  survf  yf;i) 


325X0 

Automatic  lliglit  Control  Systems 

325X1 

Avionics  Instrument  Systems 

32«XO 

Avionic  Communications 

328X1 

Avionic  Navigation  Systems 

328X4 

Avionic  Inertial  and  Radar  Navigation  Systems 

423X6 

In-Flight  Refueling  Systems  Mechanics 

423X1 

Aircraft  l.nvironmcntal  Systems  Mechanic 

431X1 

/Xircraft  Maintenance 

426X2 

Jet  luigine  Mechanic 

423X3 

Aircraft  F uel  Systems 
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AVI'I  NDIX  / ADDITiONAI  RFiSPONDl-NT  C OMMKNTS 


— Make  plastic  pages 

Ttx<  many  books,  manuals,  etc.  are  required  by  the  job  guides.  Ftiey  should  he  consolidated 
Tlie  guides  should  be  hard-backed. 

Tlie  technicians  need  previou.s  knowledge  of  the  old  T()s  and  maintenance  ex[)ericnce  to  help 
them  understand  the  procedures. 

Tlie  procedures  m the  joh  guides  are  not  detailed  enough. 

Prefer  to  use  job  guide  — style  TOs  and  checklists  together. 

Prefer  to  use  traditional-style  TOs  and  checklists  together. 

The  job  guides  are  a good  TO  to  use  for  basic  operation  and  checkout  of  systems. 

— The  foldout  pages  arc  difficult  to  use: 

- in  small  work  areas. 

- in  strong  wmd. 

- due  to  the  location  of  the  fold-out  in  relation  to  particular  stct>s. 

- because  they  don’t  fall  in  sequence  to  writings. 

- because  they  tear  too  easily. 

— The  GAM  is  very  useful  to  some  people,  but  not  useful  at  all  to  others. 

— Tlie  GAM  IS  especially  useful  in  becoming  familiar  with  the  aircraft 

— Tbe  index. 

- is  incomplete,  or  not  detailed  enougti. 

- difficult  to  use  to  locate  specific  data  rapidly. 

- sliould  list  biKik  number  as  well  as  TO  number. 

— Tlie  new  JGMs  are  more  convenient  and  easier  to  use  than  the  old  I Os 

— The  simplification  provided  by  the  job  guides  is  better  than  the  TOs,  hut  tlie  information  is  not. 

— The  job  guides  are  easier  tlian  the  TOs  to  use  for  training. 

— The  LTTAs  need  to  be  improved  and  corrected. 

— Irritated  by  requirement  to  use  JGMs  for  evey  job,  because  it  takes  longer  to  find  the  section  and 
book  than  it  takes  to  do  most  jobs. 

— The  LTTAs  are  not  complete  enough.  Tliey  don’t  go  far  enougli  to  isolate  any  difficult 
malfunctions. 

— Use  LTTAs  for  infrequent  and/or  most  difficult  troubleshooting  tasks 
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Tltc  illustrations  arc  poorly  located  in  the  book. 

The  illustrations  need  more  detail. 

- More  illustrations  could  be  used. 

Some  of  the  illustrations  are  incorrect  and  mconiph.-le. 

Ilie  illustrations  are  necessary  lor  new  people  to  complete  most  jobs. 

Sometimes  the  items  in  the  illustrations  are  too  small  to  see  details. 

IX'tailed  illustrations  keyed  to  the  step-by-step  procedures: 
make  the  bcnik  too  bip. 
arc  too  distract inp  while  reading. 
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